-- Logs begin at Thu 2022-10-20 14:01:41 UTC, end at Thu 2022-10-20 14:57:24 UTC. -- Oct 20 14:32:27.072705 dv-cinder-779233-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 20 14:32:27.080988 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 14:32:27 2022] *** Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: nodename: dv-cinder-779233-7-iscsi Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: machine: x86_64 Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: clock source: unix Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: pcre jit disabled Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: detected number of CPU cores: 4 Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: current working directory: / Oct 20 14:32:27.082958 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: detected binary path: /usr/bin/uwsgi-core Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: your processes number limit is 47680 Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: your memory page size is 4096 bytes Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: detected max file descriptor number: 2048 Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: lock engine: pthread robust mutexes Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: thunder lock: enabled Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 20 14:32:27.083538 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 14:32:27.123071 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: Python main interpreter initialized at 0x56176e2f49c0 Oct 20 14:32:27.123071 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: python threads support enabled Oct 20 14:32:27.123071 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: your server socket listen backlog is limited to 100 connections Oct 20 14:32:27.123071 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: your mercy for graceful operations on workers is 90 seconds Oct 20 14:32:27.123381 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 14:32:27.123485 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: *** Operational MODE: preforking *** Oct 20 14:32:27.123746 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: *** uWSGI is running in multiple interpreter mode *** Oct 20 14:32:27.123746 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: spawned uWSGI master process (pid: 110833) Oct 20 14:32:27.123919 dv-cinder-779233-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 20 14:32:27.125337 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: spawned uWSGI worker 1 (pid: 110834, cores: 1) Oct 20 14:32:27.125337 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: spawned uWSGI worker 2 (pid: 110835, cores: 1) Oct 20 14:32:27.125337 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 14:32:27.787256 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 14:32:27.791904 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 14:32:28.876291 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:32:28.876291 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: from cryptography.utils import int_from_bytes Oct 20 14:32:28.876909 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:32:28.876909 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: from cryptography.utils import int_from_bytes Oct 20 14:32:28.889450 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:32:28.889450 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: from cryptography.utils import int_from_bytes Oct 20 14:32:28.889871 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:32:28.889871 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: from cryptography.utils import int_from_bytes Oct 20 14:32:31.370180 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 14:32:31.370701 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 14:32:31.370910 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 14:32:31.371272 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 14:32:31.371364 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 14:32:31.371443 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 14:32:31.371521 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 14:32:31.371680 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 14:32:31.371900 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.372041 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 14:32:31.372221 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.372315 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 14:32:31.372567 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.372703 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.372880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373028 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373208 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373348 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373517 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373683 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373829 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.373996 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.374143 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.374305 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.374478 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.374624 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.374728 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.374928 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.375018 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.375253 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.375337 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779233-7-iscsi {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.375512 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.375645 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.375848 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.376061 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.376175 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779233-7-iscsi {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.376522 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.376611 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.376826 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.376911 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.377134 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.377218 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.377449 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.377534 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.377752 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.377852 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.378077 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.378245 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.378380 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.378692 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.378879 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379077 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379233 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379381 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379519 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379645 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379770 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.379908 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.380100 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.380314 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.380448 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.380536 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.380759 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.380854 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.381077 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.381164 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.381386 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.381472 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.381706 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.381800 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779233-7-iscsi {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.382012 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.382103 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.382393 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.382490 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779233-7-iscsi {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.382700 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.382783 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.383021 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.383164 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.383334 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.383434 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.383685 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.383774 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384001 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384091 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384317 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384441 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384643 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384741 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.384959 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385047 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385270 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385357 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385580 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385720 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385901 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.385997 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.386217 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.386303 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.386518 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.386617 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.386824 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.386916 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387130 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387228 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387426 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387529 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387724 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387809 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.387968 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388072 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388270 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388389 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388594 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388680 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388902 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.388986 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.389213 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.389303 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.389458 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.389544 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.389701 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.389838 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390013 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390101 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390303 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390387 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390620 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390714 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.390920 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.391013 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.391220 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.391305 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.391545 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.391700 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.391844 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392012 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392144 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392320 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392458 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392654 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392756 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.392961 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393055 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393266 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393360 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393572 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393657 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393891 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.393987 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.394206 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.394303 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.394529 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.394620 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.394837 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.394926 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.395137 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.395233 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.395469 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.395566 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.395774 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.395905 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.396075 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.396161 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.396405 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.396495 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.396722 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.396808 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397023 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397117 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397321 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397414 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397621 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397706 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.397933 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398020 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398237 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398320 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398543 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398638 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398787 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.398873 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399080 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399168 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399377 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399474 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399688 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.399985 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400072 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400283 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400423 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400613 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400703 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400906 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.400993 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.401205 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.401308 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.401503 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.401588 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.401800 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.401883 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402096 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402189 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402395 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402491 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402694 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.402991 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403085 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403291 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403384 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403590 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403676 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403887 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.403974 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.404191 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.404320 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.404524 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.404622 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.404826 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.404913 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.405125 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.405293 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.405423 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.405515 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.405721 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.405808 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406023 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406114 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406323 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406409 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406621 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406708 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.406932 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.407513 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.407801 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.407892 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.408096 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.408200 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.408422 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.408525 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.408726 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.408818 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409027 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409115 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409340 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409423 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409633 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409719 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.409933 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410020 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410242 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410327 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410540 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410632 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410836 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.410922 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.411136 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.411228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.411432 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.411527 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.411730 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.411823 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412028 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412113 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412322 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412487 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412640 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412727 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.412935 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413020 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413240 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413336 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413551 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413636 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413842 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.413926 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.414141 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.414233 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.414440 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.414525 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.414749 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.414833 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.415054 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.415144 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.415358 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.415443 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.415674 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:32:31.415758 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416005 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416093 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416332 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416446 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416679 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416766 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.416992 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.417085 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.417299 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.417390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.417609 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.417702 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.417930 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418022 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418237 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418328 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418544 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418637 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418849 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.418934 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.419159 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.419248 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.419469 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.419567 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.419778 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.419873 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.420089 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.420173 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.420423 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.420523 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.420739 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.420824 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421049 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421135 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421358 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421451 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421673 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421758 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.421981 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.422068 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.422284 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.422377 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.422612 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.423308 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.423528 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.423610 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.423777 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.423947 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.424114 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.424276 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.424473 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.424624 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.424780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.424935 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.425102 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.425245 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.425419 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.425553 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.425729 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.425891 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426036 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426201 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426344 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426512 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426680 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426825 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.426989 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.427133 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.427299 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.427458 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.427614 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.427749 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.427921 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428054 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428239 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428376 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428574 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428685 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428882 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.428982 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.429187 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.429309 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.429495 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.429622 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.429802 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.429945 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.430132 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.430258 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.430441 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.430566 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.430759 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.430882 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.431070 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.431191 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.431381 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.431499 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.431695 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.431791 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.432004 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.432092 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.432311 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.432418 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.432715 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.432829 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433021 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433108 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433322 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433408 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433624 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433715 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.433933 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434020 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434236 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434329 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434554 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434687 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434855 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.434961 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.435164 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.435250 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.435472 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.435575 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.435780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.435865 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.436082 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.436166 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.436411 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.436513 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.436721 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.436806 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437023 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437107 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437333 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437426 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437637 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437721 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.437937 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438021 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438273 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438371 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438586 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438668 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438890 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.438973 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.439202 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.439342 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.439504 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.439596 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.439809 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.439894 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.440117 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.440203 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.440447 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.440533 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.440760 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.440856 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.441071 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.441158 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.441376 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.441461 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.441697 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.441794 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442008 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442096 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442308 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442391 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442630 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442727 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.442950 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443041 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443252 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443336 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443548 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443648 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443853 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.443940 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.444152 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.444237 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.444476 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.444578 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.444778 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.444864 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445078 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445165 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445375 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445472 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445674 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445766 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.445967 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446052 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446263 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446351 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446559 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446644 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446856 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.446940 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.447157 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.447244 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.447452 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.447539 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.447750 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.447838 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448045 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448133 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448364 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448452 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448669 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448756 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.448969 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.449064 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.449307 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.449393 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.449608 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.449701 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.449941 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450025 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450249 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450336 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450560 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450655 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450874 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.450961 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.451180 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.451265 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.451486 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.451578 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.451791 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.451875 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.452099 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.452186 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.452428 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.452528 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.452743 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.452838 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453047 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453136 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453353 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453449 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453659 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453742 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.453987 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.454071 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.454310 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.454396 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.454619 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.454742 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.454935 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455020 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455238 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455334 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455550 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455637 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455873 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.455959 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.456182 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.456270 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.456516 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.456605 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.456825 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.456911 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.457133 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.457225 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.457440 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.457532 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.457748 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.457841 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458058 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458145 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458361 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458444 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458665 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458757 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.458967 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459051 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459274 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459358 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459581 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459720 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459886 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.459972 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.460183 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.460268 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.460516 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.460617 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.460842 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.460929 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.461146 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.461241 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.461458 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.461546 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.461765 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.461848 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.462081 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.462173 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.462389 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.462477 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.462694 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.462779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463002 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463089 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463308 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463608 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463694 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.463915 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464009 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464215 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464301 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464541 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464628 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464849 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.464945 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.465148 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.465244 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.465455 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.465540 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.465758 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.465891 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466057 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466145 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466354 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466439 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466660 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466754 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.466958 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467043 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467260 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467391 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467570 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467670 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467885 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.467970 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.468188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.468274 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.468511 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.468617 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.468831 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.468919 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.469137 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.469232 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.469438 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.470038 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.470339 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.470438 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.470648 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.470748 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.470954 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471041 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471261 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471354 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471566 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471659 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471879 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.471965 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.472197 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.472282 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.472526 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.472616 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.472838 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.472925 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.473144 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.473230 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.473449 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.473544 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.473759 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.473852 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474065 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474150 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474371 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474465 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474678 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474766 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.474985 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475075 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475291 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475395 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475595 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475681 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475900 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.475984 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.476205 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.476303 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.476535 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.476625 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.476841 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.476935 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.477143 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.477230 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.477449 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.477534 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.477756 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.477841 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.478061 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.478314 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.478400 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.478643 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.478736 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.478954 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.479211 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.479299 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.479543 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.479636 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.479858 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.479955 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.480177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.480272 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.480543 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.480650 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.480860 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.480956 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.481166 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.481252 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.481475 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.481563 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.481779 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.481866 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482082 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482168 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482387 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482474 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482688 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482775 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.482990 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483075 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483292 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483378 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483595 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483688 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483895 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.483989 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.484195 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.484281 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.484519 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.484607 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.484822 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.484920 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.485143 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.485303 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.485473 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.485576 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.485776 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.485875 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486075 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486161 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486378 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486462 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486687 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486786 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.486990 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487087 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487292 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487377 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487593 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487681 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487895 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.487979 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.488197 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.488291 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.488796 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.488884 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.489135 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.489221 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.489437 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.489524 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.489762 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.489855 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490065 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490158 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490385 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490478 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490691 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490786 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.490992 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491078 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491293 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491388 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491599 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491684 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491902 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.491985 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.492197 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.492294 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.492530 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.492617 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.492838 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.492924 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.493139 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.493234 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.493442 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.493534 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.493741 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.493826 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494045 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494345 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494431 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494643 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494729 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.494946 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495032 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495245 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495343 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495543 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495628 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495846 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.495931 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.496146 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.496232 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.496471 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.496572 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.496780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.496866 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497078 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497162 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497377 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497461 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497678 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497770 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.497976 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498059 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498274 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498366 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498580 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498666 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498882 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.498966 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.499182 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.499274 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.499490 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.499577 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.499796 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.499880 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.500095 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.500188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.500421 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.500507 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.500727 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.501339 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.501549 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.501727 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.501936 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.502071 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.502251 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.502386 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.502556 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.502710 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.502859 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503028 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503174 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503332 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503496 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503641 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503811 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.503944 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.504115 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.504245 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.504458 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.504571 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.504760 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.504879 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505063 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505181 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505365 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505480 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505672 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505764 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.505974 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506072 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506275 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506361 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506575 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506663 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506876 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.506970 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.507177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.507264 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.507498 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.507585 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.507806 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.507900 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.508108 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.508206 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.508434 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.508524 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.508738 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.508834 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.509076 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.509163 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.509380 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.509465 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.509694 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.509780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510004 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510098 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510312 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510399 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510621 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510708 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.510922 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511007 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511231 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511322 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511535 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511621 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511838 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.511922 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.512139 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.512223 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.512467 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.512573 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.512778 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.512852 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.513086 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.513182 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.513387 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.513479 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.513703 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.513786 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514012 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514106 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514322 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514409 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514623 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514713 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.514931 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515028 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515239 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515325 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515543 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515628 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515849 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.515943 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.516154 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.516251 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.516551 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.516654 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.516858 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.517094 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.517191 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.517412 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.517498 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.517724 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.517821 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518036 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518122 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518338 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518423 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518643 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518737 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.518944 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519031 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519248 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519332 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519556 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519692 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519858 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.519944 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.520158 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.520242 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.520478 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.520577 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.520788 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.520874 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.521094 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.521179 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.521400 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.521514 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.521704 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.521822 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.522012 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.522129 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.522314 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.522430 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.522735 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.522828 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523042 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523128 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523351 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523437 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523655 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523741 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.523953 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.524037 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.524258 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.524362 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.524596 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.524693 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.524906 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525001 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525208 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525294 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525546 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525639 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525846 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.525950 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.526151 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.526237 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.526469 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.526554 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.526768 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.526863 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527067 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527154 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527460 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527685 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.527987 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.528077 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.528290 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.528442 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.528621 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.528709 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.528941 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.529033 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.529243 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.529329 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.529561 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.529701 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.529972 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.530059 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.530281 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.530366 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.530583 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.530670 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.530910 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531014 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531235 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531323 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531537 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531630 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531847 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.531935 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.532754 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.532925 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.533145 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.533255 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.533475 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.533565 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.533784 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.533871 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.534098 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.534198 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.534402 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.534489 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.534722 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.534816 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535041 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535145 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535354 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535441 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535656 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535741 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.535978 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.536077 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.536298 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.536405 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.536637 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.536723 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.536957 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.537054 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.537310 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.537396 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.537613 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.537707 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.537915 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538003 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538223 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538310 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538527 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538613 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538828 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.538916 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.539148 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.539235 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.539450 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.539548 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.539752 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.539877 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540056 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540150 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540403 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540511 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540684 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540770 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.540985 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541071 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541292 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541386 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541601 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541686 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541901 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.541994 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.542203 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.542306 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.542521 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.542607 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.542825 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.542910 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.543131 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.543226 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.543449 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.543534 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.543755 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.543841 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.544057 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.544151 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.544363 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.544454 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.544676 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.544762 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545000 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545095 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545303 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545389 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545604 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545695 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545907 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.545995 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.546245 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.546371 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.546548 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.546633 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.546869 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.546964 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.547190 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.547277 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.547507 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.547600 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.548385 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.548483 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.548722 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.548824 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549043 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549141 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549362 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549457 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549672 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549769 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.549988 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550149 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550291 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550378 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550678 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550892 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.550987 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.551194 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.551278 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.551494 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.551578 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.551793 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.551881 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.552093 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.552185 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.552423 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.552511 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.552726 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.552816 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553043 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553132 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553328 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553413 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553628 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553723 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.553929 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554059 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554229 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554324 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554542 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554629 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554844 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.554930 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.555147 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.555242 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.555449 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.555536 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.555767 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.555853 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.556077 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.556170 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.556413 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.556503 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.556725 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.556812 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557037 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557131 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557349 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557445 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557660 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557753 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.557971 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558064 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558273 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558358 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558585 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558671 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558891 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.558978 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.559202 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.559287 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.559511 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.559714 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.559810 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.560041 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.560131 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.560364 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.560684 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.560992 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.561302 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.562628 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.562717 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.562797 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.562797 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.562797 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563013 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563100 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563185 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563305 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563402 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563547 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563636 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563891 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.563978 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.564229 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.564316 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.564568 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.564659 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.564882 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.564968 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.565193 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.565286 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.565502 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.565597 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.565815 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.565900 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.566148 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.566243 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.566447 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.566584 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.566759 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.566835 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567069 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567164 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567378 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567509 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567687 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567776 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.567993 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.568082 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.568303 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.568444 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.568633 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.568732 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.568942 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569030 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569247 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569333 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569555 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569649 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569862 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.569949 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.570174 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.570259 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.570488 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.570583 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.570799 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.570928 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.571108 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.571195 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.571416 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.571511 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.571729 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.571816 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.572041 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.572240 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.572378 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.572580 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.572691 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.572910 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573018 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573233 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573553 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573673 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.573987 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.574177 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.574305 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.574500 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.574620 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.574802 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.575105 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.575190 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.575413 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.575501 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.575717 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.575803 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576018 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576116 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576335 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576439 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576665 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576755 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.576966 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.577069 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.577282 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.577369 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.577588 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.577675 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.577912 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.578115 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.578210 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.578455 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.578542 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.578769 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.579029 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.579175 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.579291 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.579558 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.579646 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.579874 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.580034 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.580178 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.580305 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.580522 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.580612 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.580826 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.581054 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.581149 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.581398 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.581485 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.581716 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.581803 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582017 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582103 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582318 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582404 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582624 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582709 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.582928 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583016 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583228 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583314 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583534 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583633 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583834 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.583921 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.584147 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.584231 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.584477 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.584579 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.584780 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.584866 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585080 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585166 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585388 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585486 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585687 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585772 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.585988 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586072 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586287 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586423 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586587 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586672 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586891 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.586986 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.587191 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.587285 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.587494 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.587578 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.587792 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.587877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.588099 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.588185 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.588424 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.588513 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.588730 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.588819 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589035 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589124 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589336 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589422 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589645 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589732 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.589943 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590029 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590250 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590373 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590554 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590657 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590863 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.590951 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.591168 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.591252 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.591473 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.591568 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.591794 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.591879 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.592117 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.592203 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.592451 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.592672 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.592762 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593006 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593100 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593325 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593411 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593655 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593781 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.593964 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.594076 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.594274 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.594394 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.595140 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.595277 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.595443 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.595699 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.595813 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.596059 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.596234 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.596391 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.596597 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.596717 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.596914 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597044 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597248 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597363 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597565 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597687 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597870 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.597998 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.598174 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.598296 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.598476 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.598589 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.598799 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.598950 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.599112 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.599261 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.599425 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.599570 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.599736 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.599879 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600051 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600176 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600361 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600503 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600686 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600839 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.600996 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.601155 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.601308 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.601471 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.601618 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.601784 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.601928 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.602150 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.602244 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.602413 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.602536 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.602720 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.602845 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603027 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603154 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603334 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603467 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603646 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603807 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.603973 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.604125 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.604285 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.604465 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.604613 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.604786 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.605101 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.605280 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.605409 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.605596 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.605718 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.605916 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606027 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606239 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606335 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606548 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606636 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606870 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.606965 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.607191 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.607278 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.607503 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.607589 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.607823 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.608130 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.608217 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.608480 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.608572 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.608820 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.608907 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.609146 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.609234 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.609456 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.609540 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.609761 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.609927 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.610066 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.610724 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.610908 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.611032 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.611216 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.611395 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.611532 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.611719 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.611840 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.612054 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.612144 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.612426 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.612517 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.612756 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.612853 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.613059 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.613146 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.613624 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.613726 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.613925 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614022 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614332 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614532 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614618 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614833 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.614921 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.615132 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.615226 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.615433 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.615521 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.615733 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.615826 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616034 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616135 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616333 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616480 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616658 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616746 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.616958 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617093 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617259 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617344 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617559 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617645 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617858 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.617946 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.618158 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.618243 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.618457 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.618543 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.618759 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.618847 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619058 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619145 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619360 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619447 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619667 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619755 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.619967 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.620060 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.620269 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.620385 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.620615 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.620702 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.620918 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621003 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621221 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621317 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621525 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621610 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621855 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.621943 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.622170 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.622265 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.622479 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.622566 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.622787 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.622871 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.623091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.623185 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.623398 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.623487 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.623704 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.623789 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624022 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624116 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624337 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624507 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624662 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624748 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.624987 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.625075 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.625295 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.625380 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.625607 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.625702 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.625944 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626081 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626251 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626334 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626561 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626658 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626867 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.626952 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.627174 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.627262 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.627480 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.627577 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.627789 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.627874 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.628094 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.628187 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.628438 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.628548 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.628750 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.628837 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629059 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629156 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629365 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629452 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629675 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629761 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.629988 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.630081 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.630296 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.630384 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.630604 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.630688 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.630910 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631046 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631218 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631314 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631532 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631627 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631841 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.631928 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.632150 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.632238 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.632489 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.632577 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.632805 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.632913 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.633123 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.633219 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.633428 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.633515 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.633667 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110834) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 14:32:31.633762 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.634048 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.634373 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.634721 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.635033 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.635372 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.635698 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.636011 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.636321 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.636650 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:32:31.636891 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=110835) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 14:32:31.786834 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO dbcounter [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Registered counter for database nova_api Oct 20 14:32:31.789494 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO dbcounter [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Registered counter for database nova_api Oct 20 14:32:31.808157 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_db.sqlalchemy.engines [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:31.809860 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:31.815374 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writer thread running {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:31.817174 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writer thread running {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:31.871968 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.context [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed54df7a-e597-4093-8f8e-592e2d1a176d(cell1) {{(pid=110834) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 14:32:31.874480 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.context [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed54df7a-e597-4093-8f8e-592e2d1a176d(cell1) {{(pid=110835) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 14:32:31.876372 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_concurrency.lockutils [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:32:31.877087 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_concurrency.lockutils [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:32:31.878620 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_concurrency.lockutils [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:32:31.878854 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:32:31.879326 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:32:31.879416 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_concurrency.lockutils [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:32:31.879776 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_concurrency.lockutils [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:32:31.880926 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:32:31.881656 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:32:31.881745 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_concurrency.lockutils [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110834) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:32:31.882100 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:32:31.883703 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO dbcounter [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Registered counter for database nova_cell0 Oct 20 14:32:31.884067 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:32:31.886057 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO dbcounter [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Registered counter for database nova_cell0 Oct 20 14:32:31.887686 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO dbcounter [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Registered counter for database nova_cell1 Oct 20 14:32:31.889996 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO dbcounter [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Registered counter for database nova_cell1 Oct 20 14:32:31.896812 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_db.sqlalchemy.engines [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:31.897569 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_db.sqlalchemy.engines [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:31.898683 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:31.900013 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:31.904688 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writer thread running {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:31.906259 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writer thread running {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:31.906459 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writer thread running {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:31.908498 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writer thread running {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:32.050059 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO dbcounter [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Registered counter for database nova_cell0 Oct 20 14:32:32.054808 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO dbcounter [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Registered counter for database nova_cell0 Oct 20 14:32:32.058795 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG oslo_db.sqlalchemy.engines [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110834) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:32.064054 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writer thread running {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:32.064188 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_db.sqlalchemy.engines [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=110835) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:32:32.069539 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writer thread running {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:32:32.399124 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: WARNING keystonemiddleware.auth_token [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:32:32.402753 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: WARNING keystonemiddleware.auth_token [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:32:32.406311 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: WARNING keystonemiddleware.auth_token [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:32:32.410617 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: WARNING keystonemiddleware.auth_token [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:32:32.747603 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: WARNING keystonemiddleware.auth_token [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:32:32.751645 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: WARNING keystonemiddleware.auth_token [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:32:32.754246 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: WARNING keystonemiddleware.auth_token [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:32:32.757579 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: WARNING keystonemiddleware.auth_token [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:32:32.759524 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56176e2f49c0 pid: 110834 (default app) Oct 20 14:32:32.761565 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:32:32.762737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-6cbef386-33e8-4704-ba28-8929f05c0bd1 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001692 Oct 20 14:32:32.762867 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x56176e2f49c0 pid: 110835 (default app) Oct 20 14:32:32.763140 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Thu Oct 20 14:32:32 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:33:54.023858 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:33:54.025714 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002577 Oct 20 14:33:54.026123 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:33:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:33:54.038800 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_api:SELECT=3 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:54.040507 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_cell1:SELECT=3 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:54.041647 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_cell0:SELECT=3 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:54.045120 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:54.922830 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-6678a752-2c2e-423d-834f-0b46150d9315 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:33:54.955650 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-6678a752-2c2e-423d-834f-0b46150d9315 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.922662 Oct 20 14:33:54.960427 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Oct 20 14:33:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:33:57.576853 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:33:57.577845 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d8c66735-b174-4fdd-a0ca-77ad91b9c071 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Oct 20 14:33:57.578427 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:33:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:33:58.033557 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-421c8d56-0366-4368-ad30-55b88ff8c227 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "name": "cirros256", "ram": 256, "swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:33:58.082174 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-421c8d56-0366-4368-ad30-55b88ff8c227 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.497637 Oct 20 14:33:58.083041 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:33:57 2022] POST /compute/v2.1/flavors => generated 407 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:33:58.097686 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_api:SELECT=3 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:58.098517 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_cell1:SELECT=3 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:58.100471 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_cell0:SELECT=3 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:58.101203 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:33:58.313202 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d4f154ef-e51b-46de-b584-4beb2737702e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:33:58.382450 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d4f154ef-e51b-46de-b584-4beb2737702e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.290924 Oct 20 14:33:58.383023 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Oct 20 14:33:58 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:00.978788 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-421c8d56-0366-4368-ad30-55b88ff8c227 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:00.979795 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-421c8d56-0366-4368-ad30-55b88ff8c227 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Oct 20 14:34:00.980185 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:01.628282 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-156250bd-5363-462b-9585-0a8f2efbb2b7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "disk": 5, "os-flavor-access:is_public": true, "swap": 0, "ram": 512, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:01.674031 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-156250bd-5363-462b-9585-0a8f2efbb2b7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.686672 Oct 20 14:34:01.675900 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:34:01.689170 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-21d27a5e-ba72-419e-8bfe-7ff8b6749c59 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:01.730766 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-21d27a5e-ba72-419e-8bfe-7ff8b6749c59 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046380 Oct 20 14:34:01.731975 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Oct 20 14:34:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:04.408831 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-156250bd-5363-462b-9585-0a8f2efbb2b7 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:04.409841 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-156250bd-5363-462b-9585-0a8f2efbb2b7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001488 Oct 20 14:34:04.410250 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:04.818164 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-d35ae5dd-959e-4eb5-bb01-5286e6ba098b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 10, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "swap": 0, "ram": 1024, "name": "ds1G"}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:04.837676 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-d35ae5dd-959e-4eb5-bb01-5286e6ba098b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.420900 Oct 20 14:34:04.838223 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:34:04.851263 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-efa90a9c-0d26-405e-9974-1540e3826cbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:04.879200 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-efa90a9c-0d26-405e-9974-1540e3826cbb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031679 Oct 20 14:34:04.879776 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Oct 20 14:34:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:07.514386 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-d35ae5dd-959e-4eb5-bb01-5286e6ba098b admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:07.515393 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-d35ae5dd-959e-4eb5-bb01-5286e6ba098b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 20 14:34:07.516093 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:07.921134 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d34365ee-0fe2-4f24-9e4d-2d3e44dedcd5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 2048, "name": "ds2G", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:07.940569 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d34365ee-0fe2-4f24-9e4d-2d3e44dedcd5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418515 Oct 20 14:34:07.944945 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:34:07.954346 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-fa6e4b17-a666-40dd-86b5-d5e749155791 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:07.985414 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-fa6e4b17-a666-40dd-86b5-d5e749155791 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035927 Oct 20 14:34:08.005766 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Oct 20 14:34:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:10.628930 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d34365ee-0fe2-4f24-9e4d-2d3e44dedcd5 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:10.629931 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d34365ee-0fe2-4f24-9e4d-2d3e44dedcd5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Oct 20 14:34:10.630324 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:11.037209 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cf8c4a24-ae73-4f36-af48-0680f6770b94 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "vcpus": 4, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:11.055016 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cf8c4a24-ae73-4f36-af48-0680f6770b94 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.418910 Oct 20 14:34:11.055711 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:34:11.068751 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-1efbb602-efa4-4b30-86d4-a4fd92bf122f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:11.094786 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-1efbb602-efa4-4b30-86d4-a4fd92bf122f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030133 Oct 20 14:34:11.095355 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1336 bytes} [Thu Oct 20 14:34:11 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:34:13.946728 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cf8c4a24-ae73-4f36-af48-0680f6770b94 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:13.947739 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cf8c4a24-ae73-4f36-af48-0680f6770b94 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 20 14:34:13.948136 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:14.395629 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-ea70167c-bcbf-442c-8eed-f0337e400abd admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:14.421073 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-ea70167c-bcbf-442c-8eed-f0337e400abd admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.466760 Oct 20 14:34:14.421618 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Oct 20 14:34:13 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:34:16.976696 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cf8c4a24-ae73-4f36-af48-0680f6770b94 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:16.977768 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cf8c4a24-ae73-4f36-af48-0680f6770b94 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001544 Oct 20 14:34:16.978165 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:17.394447 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d05c2317-5648-4f14-8b6e-4dc0d4318483 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "disk": 1, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "rxtx_factor": 1.0, "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:17.417908 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d05c2317-5648-4f14-8b6e-4dc0d4318483 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.433501 Oct 20 14:34:17.418538 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:16 2022] POST /compute/v2.1/flavors => generated 402 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:34:17.430698 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-dbb8597c-d4ee-47af-9996-4896ef7ee630 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:17.459788 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-dbb8597c-d4ee-47af-9996-4896ef7ee630 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032693 Oct 20 14:34:17.460792 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Oct 20 14:34:17 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:20.177984 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d05c2317-5648-4f14-8b6e-4dc0d4318483 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:20.178899 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d05c2317-5648-4f14-8b6e-4dc0d4318483 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 20 14:34:20.179295 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:20.580977 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-6ab511f6-12e5-4a8d-97dc-80dbf4b63cb7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "name": "m1.small", "vcpus": 1}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:20.600486 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-6ab511f6-12e5-4a8d-97dc-80dbf4b63cb7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.414717 Oct 20 14:34:20.601019 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:20 2022] POST /compute/v2.1/flavors => generated 405 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:34:20.613813 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-d46b14ee-fd06-433f-a4c0-dca9dfb7621a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:20.638770 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-d46b14ee-fd06-433f-a4c0-dca9dfb7621a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028829 Oct 20 14:34:20.639337 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Oct 20 14:34:20 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:23.275011 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-6ab511f6-12e5-4a8d-97dc-80dbf4b63cb7 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:23.276660 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-6ab511f6-12e5-4a8d-97dc-80dbf4b63cb7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Oct 20 14:34:23.277214 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:23.726926 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-ca218db6-7754-4eb8-bbd4-3f79cccf40ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:23.752922 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-ca218db6-7754-4eb8-bbd4-3f79cccf40ba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.469113 Oct 20 14:34:23.754129 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:23 2022] POST /compute/v2.1/flavors => generated 406 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:34:23.765869 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-9a2f712e-1b99-4d7f-a03d-d21d0ae6b990 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:23.794568 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-9a2f712e-1b99-4d7f-a03d-d21d0ae6b990 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032275 Oct 20 14:34:23.795154 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Oct 20 14:34:23 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:26.421414 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-ca218db6-7754-4eb8-bbd4-3f79cccf40ba admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:26.422584 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-ca218db6-7754-4eb8-bbd4-3f79cccf40ba admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001539 Oct 20 14:34:26.423149 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:26.862158 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-3b34143d-2574-41d6-99ed-3e51e4f61f1f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "id": "4", "name": "m1.large", "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 80}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:26.870189 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:26.889472 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-3b34143d-2574-41d6-99ed-3e51e4f61f1f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.460199 Oct 20 14:34:26.890332 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:34:26.902719 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-c7f37b19-7502-48dd-8858-b5c932d58a2c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:26.929621 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-c7f37b19-7502-48dd-8858-b5c932d58a2c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031077 Oct 20 14:34:26.930303 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Oct 20 14:34:26 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:29.541848 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-3b34143d-2574-41d6-99ed-3e51e4f61f1f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:29.544143 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-3b34143d-2574-41d6-99ed-3e51e4f61f1f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002720 Oct 20 14:34:29.544578 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:29 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:30.023958 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-0a795b72-f8a6-46a0-bcec-9d11932b9d24 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.xlarge", "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 16384, "disk": 160}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:30.034648 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:30.048326 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-0a795b72-f8a6-46a0-bcec-9d11932b9d24 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.496678 Oct 20 14:34:30.049246 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1283 bytes} [Thu Oct 20 14:34:29 2022] POST /compute/v2.1/flavors => generated 408 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:34:30.061061 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-61522f58-7e54-4bc3-ad66-445cd30ed55e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:30.089023 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-61522f58-7e54-4bc3-ad66-445cd30ed55e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030908 Oct 20 14:34:30.090245 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1333 bytes} [Thu Oct 20 14:34:30 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:34:48.937222 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-0a795b72-f8a6-46a0-bcec-9d11932b9d24 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:48.938179 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-0a795b72-f8a6-46a0-bcec-9d11932b9d24 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Oct 20 14:34:48.938580 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:34:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:48.949764 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:34:49.326416 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-50b526be-58f4-4a5f-a10d-1d1d6ba3a73e admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:49.344278 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-50b526be-58f4-4a5f-a10d-1d1d6ba3a73e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.399608 Oct 20 14:34:49.344838 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Oct 20 14:34:48 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:34:50.639964 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-0a795b72-f8a6-46a0-bcec-9d11932b9d24 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:50.641000 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-0a795b72-f8a6-46a0-bcec-9d11932b9d24 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Oct 20 14:34:50.641397 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:34:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:51.155562 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-ba7820fa-0cf3-4c90-be7b-6d6ba90d3c47 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:51.160858 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.wsgi [None req-ba7820fa-0cf3-4c90-be7b-6d6ba90d3c47 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-ba7820fa-0cf3-4c90-be7b-6d6ba90d3c47 admin admin] Request method failure captured: Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Accept: application/json Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Accept-Encoding: gzip, deflate Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Connection: keep-alive Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Content-Length: 0 Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Host: 10.222.0.13 Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Openstack-Api-Version: compute 2.92 Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Openstack-System-Scope: None Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: User-Agent: python-novaclient Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Auth-Token: gAAAAABjUVyKG6_yXLJkkFRnyHCFfgwN2bmM201x9aQFyo5e5D6viKB6HBwbG0_5SOwhLE0R_4j0nPQoBJ3MAEgeTj9jOxp3fRzGHVoq0m9YIwhSlhndBF5ejC4pjHQ_4XqqFzOmVPajAhetaVFlJu8xSquNrLTJ7WUkk8XqtM1GPlv5OMPBVrw Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Domain-Id: None Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Domain-Name: None Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Identity-Status: Confirmed Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Is-Admin-Project: True Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Domain-Id: default Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Domain-Name: Default Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Name: admin Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Role: reader,admin,member Oct 20 14:34:51.164091 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Roles: reader,admin,member Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfa845f715934496950bc728f50bbff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfa845f715934496950bc728f50bbff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant: admin Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant-Name: admin Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User: admin Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Domain-Id: default Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Domain-Name: Default Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Id: 75ee7ae2d2194fbf9ae79851bb412a22 Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Name: admin Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: method: > Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: exception: Flavor 42 could not be found. Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: action_args: {'id': '42'} Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:34:51.165863 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:51.166880 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.169252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-ba7820fa-0cf3-4c90-be7b-6d6ba90d3c47 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:34:51.170517 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-ba7820fa-0cf3-4c90-be7b-6d6ba90d3c47 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.386337 Oct 20 14:34:51.170517 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Oct 20 14:34:50 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 387 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:51.176569 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-9b96b5d9-04bf-4604-8ad5-2b4dd2fbaf19 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:51.199802 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-9b96b5d9-04bf-4604-8ad5-2b4dd2fbaf19 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027466 Oct 20 14:34:51.200325 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Oct 20 14:34:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:34:51.210826 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-0a51a76f-41c4-405a-9079-937836a72bf5 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:51.233704 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-0a51a76f-41c4-405a-9079-937836a72bf5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027383 Oct 20 14:34:51.234252 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Oct 20 14:34:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:34:51.243790 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-c682d3c0-505a-4dc3-9977-768f050f8404 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:51.249904 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.wsgi [None req-c682d3c0-505a-4dc3-9977-768f050f8404 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-c682d3c0-505a-4dc3-9977-768f050f8404 admin admin] Request method failure captured: Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Accept: application/json Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Accept-Encoding: gzip, deflate Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Connection: keep-alive Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Content-Length: 0 Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Host: 10.222.0.13 Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Openstack-Api-Version: compute 2.92 Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Openstack-System-Scope: None Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: User-Agent: python-novaclient Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Auth-Token: gAAAAABjUVyKG6_yXLJkkFRnyHCFfgwN2bmM201x9aQFyo5e5D6viKB6HBwbG0_5SOwhLE0R_4j0nPQoBJ3MAEgeTj9jOxp3fRzGHVoq0m9YIwhSlhndBF5ejC4pjHQ_4XqqFzOmVPajAhetaVFlJu8xSquNrLTJ7WUkk8XqtM1GPlv5OMPBVrw Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Domain-Id: None Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Domain-Name: None Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Identity-Status: Confirmed Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Is-Admin-Project: True Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Domain-Id: default Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Domain-Name: Default Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Name: admin Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Role: reader,admin,member Oct 20 14:34:51.253140 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Roles: reader,admin,member Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfa845f715934496950bc728f50bbff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfa845f715934496950bc728f50bbff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant: admin Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant-Name: admin Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User: admin Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Domain-Id: default Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Domain-Name: Default Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Id: 75ee7ae2d2194fbf9ae79851bb412a22 Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Name: admin Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: method: > Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: exception: Flavor 42 could not be found. Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: action_args: {'id': '42'} Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:34:51.254590 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:51.255689 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:51.257001 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-c682d3c0-505a-4dc3-9977-768f050f8404 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=110835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:34:51.258184 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-c682d3c0-505a-4dc3-9977-768f050f8404 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014245 Oct 20 14:34:51.258184 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Oct 20 14:34:51 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:52.466989 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-0a51a76f-41c4-405a-9079-937836a72bf5 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:52.468044 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-0a51a76f-41c4-405a-9079-937836a72bf5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Oct 20 14:34:52.468467 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:52.986741 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-467a04b6-1d3e-4327-b213-1b6fcac3b972 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:52.992517 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.wsgi [None req-467a04b6-1d3e-4327-b213-1b6fcac3b972 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-467a04b6-1d3e-4327-b213-1b6fcac3b972 admin admin] Request method failure captured: Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Accept: application/json Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Accept-Encoding: gzip, deflate Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Connection: keep-alive Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Content-Length: 0 Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Host: 10.222.0.13 Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Openstack-Api-Version: compute 2.92 Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Openstack-System-Scope: None Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: User-Agent: python-novaclient Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Auth-Token: gAAAAABjUVyMEPC2waepIbW2EleiHXvDWfuq13bpmY_9xqJnLYQDvULf3s6wlO_0iD3bmsz6jgfu_KmckMfdLdCSZSkNitsxoVMUWc7vKS9jsGbd7blej2g5BL9RxHzUoDYgmRX2QlsAc0aQ0NNntGIILWhw4kwQPMMBoRXGYkT__Co780n1VZM Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Domain-Id: None Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Domain-Name: None Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Identity-Status: Confirmed Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Is-Admin-Project: True Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Domain-Id: default Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Domain-Name: Default Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Name: admin Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Role: reader,admin,member Oct 20 14:34:52.994228 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Roles: reader,admin,member Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfa845f715934496950bc728f50bbff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfa845f715934496950bc728f50bbff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant: admin Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant-Name: admin Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User: admin Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Domain-Id: default Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Domain-Name: Default Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Id: 75ee7ae2d2194fbf9ae79851bb412a22 Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Name: admin Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: method: > Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: exception: Flavor 84 could not be found. Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: action_args: {'id': '84'} Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:34:52.995779 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:52.996670 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:52.997877 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-467a04b6-1d3e-4327-b213-1b6fcac3b972 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:34:52.999083 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-467a04b6-1d3e-4327-b213-1b6fcac3b972 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388655 Oct 20 14:34:52.999083 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Oct 20 14:34:52 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 20 14:34:53.005586 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-feee9138-6462-46d4-960e-9cd1a146386b admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:53.020802 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-feee9138-6462-46d4-960e-9cd1a146386b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018857 Oct 20 14:34:53.021317 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Oct 20 14:34:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:34:53.031113 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-728e0ee7-a064-43c6-879d-6e200e79a672 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:53.047224 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-728e0ee7-a064-43c6-879d-6e200e79a672 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020163 Oct 20 14:34:53.047738 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Oct 20 14:34:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:34:53.056665 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-655e92fd-42da-4614-960a-2d477a4a517d admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:53.061700 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.wsgi [None req-655e92fd-42da-4614-960a-2d477a4a517d admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-655e92fd-42da-4614-960a-2d477a4a517d admin admin] Request method failure captured: Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Accept: application/json Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Accept-Encoding: gzip, deflate Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Connection: keep-alive Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Content-Length: 0 Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Host: 10.222.0.13 Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Openstack-Api-Version: compute 2.92 Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Openstack-System-Scope: None Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: User-Agent: python-novaclient Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Auth-Token: gAAAAABjUVyMEPC2waepIbW2EleiHXvDWfuq13bpmY_9xqJnLYQDvULf3s6wlO_0iD3bmsz6jgfu_KmckMfdLdCSZSkNitsxoVMUWc7vKS9jsGbd7blej2g5BL9RxHzUoDYgmRX2QlsAc0aQ0NNntGIILWhw4kwQPMMBoRXGYkT__Co780n1VZM Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Domain-Id: None Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Domain-Name: None Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Identity-Status: Confirmed Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Is-Admin-Project: True Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Domain-Id: default Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Domain-Name: Default Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Name: admin Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Role: reader,admin,member Oct 20 14:34:53.063188 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Roles: reader,admin,member Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfa845f715934496950bc728f50bbff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfa845f715934496950bc728f50bbff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant: admin Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant-Name: admin Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User: admin Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Domain-Id: default Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Domain-Name: Default Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Id: 75ee7ae2d2194fbf9ae79851bb412a22 Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Name: admin Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: method: > Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: exception: Flavor 84 could not be found. Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: action_args: {'id': '84'} Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:34:53.064806 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:53.065625 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:53.066827 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-655e92fd-42da-4614-960a-2d477a4a517d admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=110834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:34:53.067858 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-655e92fd-42da-4614-960a-2d477a4a517d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011307 Oct 20 14:34:53.067858 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1190 bytes} [Thu Oct 20 14:34:53 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 20 14:34:54.286697 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-728e0ee7-a064-43c6-879d-6e200e79a672 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:54.287696 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-728e0ee7-a064-43c6-879d-6e200e79a672 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Oct 20 14:34:54.288088 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:34:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:54.808552 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cd55da93-4635-4486-8821-60da6c93c2c1 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:54.814260 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.wsgi [None req-cd55da93-4635-4486-8821-60da6c93c2c1 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cd55da93-4635-4486-8821-60da6c93c2c1 admin admin] Request method failure captured: Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Accept: application/json Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Accept-Encoding: gzip, deflate Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Connection: keep-alive Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Content-Length: 0 Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Host: 10.222.0.13 Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Openstack-Api-Version: compute 2.92 Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Openstack-System-Scope: None Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: User-Agent: python-novaclient Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Auth-Token: gAAAAABjUVyOicnWoVIKcTc0qV7GW93rY18JTdal0ek87xxeSRS9jZhPBihXB1-Yoo08m35tEDkyDibl7FX9eF-nkkwZ15IybH73z_UbbVTtxcDw6opFE9KhJWxxsC9AQF52z7M1E2XRAziP3za1DbNVYJ1Y6WAneWFcp8opxM0LLGSX9b7I9gM Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Domain-Id: None Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Domain-Name: None Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Identity-Status: Confirmed Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Is-Admin-Project: True Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Domain-Id: default Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Domain-Name: Default Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Project-Name: admin Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Role: reader,admin,member Oct 20 14:34:54.815737 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Roles: reader,admin,member Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfa845f715934496950bc728f50bbff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfa845f715934496950bc728f50bbff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant: admin Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-Tenant-Name: admin Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User: admin Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Domain-Id: default Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Domain-Name: Default Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Id: 75ee7ae2d2194fbf9ae79851bb412a22 Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: X-User-Name: admin Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: method: > Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: exception: Flavor 451 could not be found. Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: action_args: {'id': '451'} Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:34:54.817367 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:54.818289 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.819592 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cd55da93-4635-4486-8821-60da6c93c2c1 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110834) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:34:54.820795 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cd55da93-4635-4486-8821-60da6c93c2c1 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.392174 Oct 20 14:34:54.820795 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Oct 20 14:34:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 20 14:34:54.827333 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-c9c6ec74-7fa5-40ba-8518-197c6ccfcda7 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:54.842565 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-c9c6ec74-7fa5-40ba-8518-197c6ccfcda7 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019249 Oct 20 14:34:54.843078 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Oct 20 14:34:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:34:54.852388 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:54.867876 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018998 Oct 20 14:34:54.868417 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1210 bytes} [Thu Oct 20 14:34:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:34:54.877491 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-295f4eb8-836b-42d8-9d5d-961e886cef81 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:54.882288 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.wsgi [None req-295f4eb8-836b-42d8-9d5d-961e886cef81 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-295f4eb8-836b-42d8-9d5d-961e886cef81 admin admin] Request method failure captured: Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Accept: application/json Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Accept-Encoding: gzip, deflate Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Connection: keep-alive Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Content-Length: 0 Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Host: 10.222.0.13 Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Openstack-Api-Version: compute 2.92 Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Openstack-System-Scope: None Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: User-Agent: python-novaclient Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Auth-Token: gAAAAABjUVyOicnWoVIKcTc0qV7GW93rY18JTdal0ek87xxeSRS9jZhPBihXB1-Yoo08m35tEDkyDibl7FX9eF-nkkwZ15IybH73z_UbbVTtxcDw6opFE9KhJWxxsC9AQF52z7M1E2XRAziP3za1DbNVYJ1Y6WAneWFcp8opxM0LLGSX9b7I9gM Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Domain-Id: None Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Domain-Name: None Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Identity-Status: Confirmed Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Is-Admin-Project: True Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Openstack-Nova-Api-Version: 2.92 Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Domain-Id: default Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Domain-Name: Default Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Project-Name: admin Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Role: reader,admin,member Oct 20 14:34:54.883827 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Roles: reader,admin,member Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_cfa845f715934496950bc728f50bbff3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/cfa845f715934496950bc728f50bbff3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/cfa845f715934496950bc728f50bbff3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant: admin Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant-Id: cfa845f715934496950bc728f50bbff3 Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-Tenant-Name: admin Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User: admin Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Domain-Id: default Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Domain-Name: Default Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Id: 75ee7ae2d2194fbf9ae79851bb412a22 Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: X-User-Name: admin Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: method: > Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: exception: Flavor 451 could not be found. Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: action_args: {'id': '451'} Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:34:54.885390 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:54.886352 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: ERROR nova.api.openstack.wsgi Oct 20 14:34:54.888177 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-295f4eb8-836b-42d8-9d5d-961e886cef81 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=110835) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:34:54.889386 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-295f4eb8-836b-42d8-9d5d-961e886cef81 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011117 Oct 20 14:34:54.889386 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Oct 20 14:34:54 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 20 14:34:56.108399 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:56.109654 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Oct 20 14:34:56.110048 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:56.638158 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-6adea52b-1076-4bec-a64b-aa2167ab9969 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:56.658251 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-6adea52b-1076-4bec-a64b-aa2167ab9969 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.409901 Oct 20 14:34:56.658782 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Oct 20 14:34:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:34:57.861756 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:57.862771 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Oct 20 14:34:57.863167 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:34:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:34:58.383691 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-b2b1e41e-f12f-4543-9263-be0ad93ccdcd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:34:58.403279 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-b2b1e41e-f12f-4543-9263-be0ad93ccdcd admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.398334 Oct 20 14:34:58.403809 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Oct 20 14:34:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:34:59.613552 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:34:59.614588 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 20 14:34:59.614989 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:34:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:35:00.131518 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-7ce4df73-71d0-484d-b383-ef77d983b9a4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:35:00.151032 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-7ce4df73-71d0-484d-b383-ef77d983b9a4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.398395 Oct 20 14:35:00.151637 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Oct 20 14:34:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:35:01.376504 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:35:01.377505 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Oct 20 14:35:01.377896 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:35:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:35:01.898498 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-93a64e53-e209-44be-a46a-3e3a60e5624c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:35:01.917950 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-93a64e53-e209-44be-a46a-3e3a60e5624c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.397005 Oct 20 14:35:01.918485 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1235 bytes} [Thu Oct 20 14:35:01 2022] POST /compute/v2.1/flavors => generated 409 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:35:03.187960 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:35:03.189291 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001791 Oct 20 14:35:03.190657 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:35:03 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:35:03.728056 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-bd83bfbe-a13f-4b4d-a0cb-fb7d41dbc1ad admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:35:03.748990 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-bd83bfbe-a13f-4b4d-a0cb-fb7d41dbc1ad admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.409075 Oct 20 14:35:03.749528 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1202 bytes} [Thu Oct 20 14:35:03 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:36:00.344368 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:36:00.345386 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-cac96cbe-57fd-4968-8b35-b4dbd222f46f admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Oct 20 14:36:00.345782 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 931 bytes} [Thu Oct 20 14:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:36:00.356318 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:00.730320 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-5a3e2168-06da-4d48-9f1d-76800ec38df0 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:36:00.750576 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-5a3e2168-06da-4d48-9f1d-76800ec38df0 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.398780 Oct 20 14:36:00.751102 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1292 bytes} [Thu Oct 20 14:36:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:36:00.772466 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_api:SELECT=14 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:36:00.776566 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-d9477847-57c9-45bf-965b-363cc856afe9 admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:36:00.784424 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-d9477847-57c9-45bf-965b-363cc856afe9 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013371 Oct 20 14:36:00.784940 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1283 bytes} [Thu Oct 20 14:36:00 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:36:00.796501 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-78bfceae-70b9-4c03-a8ea-d75bd1a85e53 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:36:00.803588 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-78bfceae-70b9-4c03-a8ea-d75bd1a85e53 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010760 Oct 20 14:36:00.804089 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1286 bytes} [Thu Oct 20 14:36:00 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:36:00.815094 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:36:00.822213 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010535 Oct 20 14:36:00.822728 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1286 bytes} [Thu Oct 20 14:36:00 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:36:00.834031 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-815f422d-ee60-4bdf-a7f9-f59a8d335adb admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:36:00.840989 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-815f422d-ee60-4bdf-a7f9-f59a8d335adb admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010325 Oct 20 14:36:00.842062 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1283 bytes} [Thu Oct 20 14:36:00 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:38:53.762541 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:38:53.763553 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 20 14:38:53.763923 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 35/69] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:38:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:38:53.904645 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_api:SELECT=6 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:38:54.065225 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:38:54.069847 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:38:54.070316 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:38:54.070742 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:38:54.071445 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:38:54.071885 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:38:54.072297 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:38:54.104142 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-55cdd2bc-3c29-44a3-ba68-8f45fe636568 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201217 Oct 20 14:38:54.104727 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 35/70] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Oct 20 14:38:53 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:38:55.199382 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:38:55.201133 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Oct 20 14:38:55.201731 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 36/71] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:38:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:38:55.393737 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:38:55.397479 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:38:55.397954 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:38:55.398376 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:38:55.399074 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:38:55.399515 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:38:55.399925 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:38:55.419734 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-1523be31-4f25-4a69-9cdf-d927a75db8dc admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.076634 Oct 20 14:38:55.420281 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 36/72] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Oct 20 14:38:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:39:06.911541 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:39:06.913166 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001766 Oct 20 14:39:06.913619 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 37/73] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:39:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:39:07.064322 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_cell0:SELECT=4 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:39:07.065107 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_cell1:SELECT=4 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:39:07.065834 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG dbcounter [-] [110835] Writing DB stats nova_api:SELECT=8 {{(pid=110835) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:39:07.117540 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:39:07.121982 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:39:07.122602 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:39:07.123050 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:39:07.123901 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:39:07.124740 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:39:07.125236 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:39:07.152837 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-58204ae3-8d54-431e-9922-42238750faa1 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.092976 Oct 20 14:39:07.153932 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 37/74] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Oct 20 14:39:07 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:39:08.259904 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG nova.api.openstack.wsgi [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] Calling method '>' {{(pid=110834) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:39:08.260957 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: INFO nova.api.openstack.requestlog [None req-c3721c84-203c-49f0-b4dc-6b5478c5aa4c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001528 Oct 20 14:39:08.261359 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: [pid: 110834|app: 0|req: 38/75] 10.222.0.13 () {56 vars in 1074 bytes} [Thu Oct 20 14:39:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:39:08.450963 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG nova.api.openstack.wsgi [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Calling method '>' {{(pid=110835) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:39:08.454324 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:39:08.454797 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:39:08.455222 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:39:08.455927 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:39:08.456385 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:39:08.456805 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: DEBUG oslo_concurrency.lockutils [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=110835) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:39:08.477639 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: INFO nova.api.openstack.requestlog [None req-34804128-e12e-4f35-a94b-df3dd794a8ab admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.078046 Oct 20 14:39:08.478170 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: [pid: 110835|app: 0|req: 38/76] 10.222.0.13 () {60 vars in 1193 bytes} [Thu Oct 20 14:39:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:40:04.382423 dv-cinder-779233-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 20 14:40:04.383034 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: Thu Oct 20 14:40:04 2022 - graceful shutdown triggered... Oct 20 14:40:04.383461 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: Gracefully killing worker 1 (pid: 110834)... Oct 20 14:40:04.383818 dv-cinder-779233-7-iscsi devstack@n-api.service[110835]: Gracefully killing worker 2 (pid: 110835)... Oct 20 14:40:04.508903 dv-cinder-779233-7-iscsi devstack@n-api.service[110834]: DEBUG dbcounter [-] [110834] Writing DB stats nova_api:SELECT=4 {{(pid=110834) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:05.383078 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: worker 1 buried after 1 seconds Oct 20 14:40:05.383585 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: worker 2 buried after 1 seconds Oct 20 14:40:05.383585 dv-cinder-779233-7-iscsi devstack@n-api.service[110833]: goodbye to uWSGI. Oct 20 14:40:05.384760 dv-cinder-779233-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 20 14:40:05.385303 dv-cinder-779233-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 20 14:40:05.388163 dv-cinder-779233-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 20 14:40:05.399242 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Oct 20 14:40:05 2022] *** Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: nodename: dv-cinder-779233-7-iscsi Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: machine: x86_64 Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: clock source: unix Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: pcre jit disabled Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: detected number of CPU cores: 4 Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: current working directory: / Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: detected binary path: /usr/bin/uwsgi-core Oct 20 14:40:05.401892 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: your processes number limit is 47680 Oct 20 14:40:05.402776 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: your memory page size is 4096 bytes Oct 20 14:40:05.402776 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: detected max file descriptor number: 2048 Oct 20 14:40:05.402776 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: lock engine: pthread robust mutexes Oct 20 14:40:05.402776 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: thunder lock: enabled Oct 20 14:40:05.402776 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 20 14:40:05.402776 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 20 14:40:05.444774 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: Python main interpreter initialized at 0x5621f9b479c0 Oct 20 14:40:05.444774 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: python threads support enabled Oct 20 14:40:05.444774 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: your server socket listen backlog is limited to 100 connections Oct 20 14:40:05.444774 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: your mercy for graceful operations on workers is 90 seconds Oct 20 14:40:05.445359 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: mapped 403077 bytes (393 KB) for 2 cores Oct 20 14:40:05.445359 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: *** Operational MODE: preforking *** Oct 20 14:40:05.445566 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: *** uWSGI is running in multiple interpreter mode *** Oct 20 14:40:05.445566 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: spawned uWSGI master process (pid: 125798) Oct 20 14:40:05.445670 dv-cinder-779233-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 20 14:40:05.447608 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: spawned uWSGI worker 1 (pid: 125810, cores: 1) Oct 20 14:40:05.447608 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: spawned uWSGI worker 2 (pid: 125811, cores: 1) Oct 20 14:40:05.447608 dv-cinder-779233-7-iscsi devstack@n-api.service[125798]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 20 14:40:06.114418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 14:40:06.127720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 20 14:40:07.300113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:40:07.300113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: from cryptography.utils import int_from_bytes Oct 20 14:40:07.300766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:40:07.300766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: from cryptography.utils import int_from_bytes Oct 20 14:40:07.310742 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:40:07.310742 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: from cryptography.utils import int_from_bytes Oct 20 14:40:07.311330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 20 14:40:07.311330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: from cryptography.utils import int_from_bytes Oct 20 14:40:09.801061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 14:40:09.801743 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 14:40:09.801840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 14:40:09.802191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 14:40:09.802450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 14:40:09.802842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.803170 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.803296 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 20 14:40:09.803663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.803752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 20 14:40:09.803936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.804080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 20 14:40:09.804270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.804477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 20 14:40:09.804619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.804744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 20 14:40:09.804948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.805139 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.805275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.805471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.805608 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.805806 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.805993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.806188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.806303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.806518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779233-7-iscsi {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.806634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.806862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.806980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.807164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808028 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.808838 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.809014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.809213 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.809475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.809657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-779233-7-iscsi {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.809657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.809952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.810123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.810123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.810123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.811065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.811216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.811460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.811854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.812034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.812272 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.812527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.812745 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.812954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.813175 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.813394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.813604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.813811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814793 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.814986 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.815197 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.815345 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.815492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.815631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.815790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779233-7-iscsi {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-779233-7-iscsi {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816853 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.816963 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817647 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.817899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.818985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.819183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.819383 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.819532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.819684 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.819790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.819918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.820101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.820276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.820450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.820615 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.820776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.820935 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821371 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821473 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821636 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821736 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.821962 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.822070 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.822251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.822352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.822576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.822679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.822903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.823008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.823158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.823360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.823535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.823674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.823852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824329 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.824978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.825118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.825286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.825385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.825595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.825772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.826306 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.826480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.826587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.826686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.826778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.826903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.827097 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.827247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.827345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.827430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.827675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.827867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828130 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828718 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.828968 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.829065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.829281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.829377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.829623 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.829712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.829946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.830036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.830256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.830357 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.830581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.830679 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.830902 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831642 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.831932 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.832154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.832243 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.832517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.832626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.832832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.832934 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.833085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.833173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.833388 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.833499 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.833699 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.833817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834327 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834735 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.834946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835096 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.835962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.836131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.836295 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.836466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.836600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.836778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.836925 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.837092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.837239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.837386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.837526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.837716 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.837865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838589 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838741 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.838888 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839464 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839622 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.839919 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840685 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.840995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.841134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.841322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.841972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.842166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.842321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.842542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.842683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.842869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843477 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.843955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.844089 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.844240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.844433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.844576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.844755 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.844888 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.845066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.845217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.845362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.845498 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.845754 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.845895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846338 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846638 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.846940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847088 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847546 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847687 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.847975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.848123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.848283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.848556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.848699 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.848846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.848987 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.849128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.849278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.849427 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.849567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 20 14:40:09.849724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.849874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850189 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850622 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.850908 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.851062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.851214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.851362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.851511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.851691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.851863 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.852018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.852110 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.852357 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.852492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.852694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.852802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853434 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853756 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.853983 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.854086 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.854308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.854397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.854626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.854723 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.854948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.855997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.856227 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.856325 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.857891 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.858966 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859516 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859609 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.859926 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.860153 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.860258 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.860531 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.860639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.860853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.860951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.861433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.861568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.861766 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.861867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.862082 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.862180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.862401 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.862500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.862722 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.862813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863449 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863662 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.863978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.864067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.864295 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.864502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.864649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.864740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.864976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.865078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.865296 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.865394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.865613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.865703 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.865932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866344 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866565 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866655 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.866982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.867190 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.867287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.867498 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.867595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.867805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.867909 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.868115 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.868204 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.868445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.868549 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.868758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.868862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.869089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.869187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.869398 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.869486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.869723 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.869820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870127 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.870973 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.871063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.871283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.871374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.871594 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.871719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.871906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.872004 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.872215 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.872311 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.872551 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.872649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.872910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873535 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873624 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873845 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.873942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.874157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.874277 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.874471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.874568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.874784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.874881 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.875099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.875203 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.875413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.875509 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.875724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.875813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.876039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.876143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.876396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.876491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.876692 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.876784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.877984 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.878124 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.878313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.878439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.878637 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.878761 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.878936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.879251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.879561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.879720 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.879884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.880033 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.880258 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.880436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.880584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.880724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.880872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881464 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881611 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881763 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.881929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.882071 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.882217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.882358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.882566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.882713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.882863 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883611 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.883977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.884126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.884273 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.884468 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.884621 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.884763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.884903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.885082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.885232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.885398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.885554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.885733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.885896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886355 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.886974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.887128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.887291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.887458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.887600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.887751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.887907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.888048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.888233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.888444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.888725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.888871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889166 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889739 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.889879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.890923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.891078 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.891226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.891399 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.891554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.891718 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.891875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.892028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.892176 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.892323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.892525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.892674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.892869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893639 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.893959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.894116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.894273 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.894438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.894594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.894748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.894896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895219 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895705 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.895993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.896150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.896323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.896525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.896667 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.896813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.896985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.897134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.897282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.897432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.897604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.897759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.897943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.898105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.898277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.898437 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.898586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.898728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.898893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899038 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.899970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.900131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.900279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.900452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.900595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.900745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.900893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901042 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901799 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.901948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.902099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.902266 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.902422 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.902599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.902754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.903211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.903364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.903364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.903634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.904523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.904693 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.904837 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905348 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905643 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.905934 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.906964 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.907116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.907264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.907414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.907563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.907710 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.907853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908455 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908748 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.908905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.909060 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.909220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.909361 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.909501 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.909651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.909651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910012 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910297 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.910896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911059 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911214 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.911957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.912110 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.912251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.912416 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.912587 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.912729 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.912885 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913175 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.913880 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.914027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.914175 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.914330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.914472 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.914612 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.914769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.915007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.915175 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.915322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.915476 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.915672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.915830 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.916004 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.916152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.916323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.916569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.916719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.916882 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917324 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917512 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917807 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.917947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.918086 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.918365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.918527 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.918670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.918810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.918968 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.919114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.919274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.919424 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.919601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.920287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.920512 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.920672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.920817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.920966 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.921116 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.921265 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.921415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.921576 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.921719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.921860 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922001 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922647 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.922940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.923240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.923405 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.923557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.923741 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.923889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.924059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.924220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.924433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.924583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.924724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.924875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.925916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.926071 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.926219 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.926361 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.926563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.926720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.926868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927208 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927546 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927701 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.927995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.928136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.928283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.928476 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.928634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.928786 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.928928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929076 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929833 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.929981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.930129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.930279 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.930427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.930581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.930723 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.930871 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931485 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931626 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.931917 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.932065 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.932255 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.932421 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.932568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.932719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.932869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.933019 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.933169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.933328 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.933480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.933621 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.933921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934075 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934807 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.934962 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.935110 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.935296 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.935456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.935598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.935746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.935897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936038 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936328 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936494 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936636 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936791 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.936934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.937073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.937215 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.937373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.937522 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.937677 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.937819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938041 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938562 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938704 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938845 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.938994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.939137 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.939309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.939463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.939606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.939747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.939888 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940187 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940331 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.940963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.941113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.941272 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.941415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.941563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.941705 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.941845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942219 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942514 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.942966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943387 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943839 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.943988 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.944129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.944270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.944451 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.944632 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.944782 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.944930 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.945084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.945251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.945398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.945559 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.945715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.945870 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946025 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946328 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946485 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946485 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946773 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.946928 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947693 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.947994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.948149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.948298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.948478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.948627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.948782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.948929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.949090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.949261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.949413 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.949559 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.949714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.949875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.950024 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.950170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.950317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.950471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.950619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.950776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.951445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.951604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.951752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.951899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.951899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.952190 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.952381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.952537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.952730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.952889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953196 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.953957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.954112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.954267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.954414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.954560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.954715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.954870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955166 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955625 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955781 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.955930 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956079 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956226 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.956965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.957265 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.957414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.957592 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.957750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.957907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.958979 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.959127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.959376 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.959543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.959709 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.959875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.960999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.961154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.961317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.961467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.961622 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.961782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.961935 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.962084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.962379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.962553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.962711 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.962868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963758 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.963924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.964074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.964235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.964462 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.964631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.964781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.964929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.965084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.965240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.965390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.965545 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.965694 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.965853 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.966019 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.966169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.966317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.966490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.967160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.967310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.967472 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.967630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.967788 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.967788 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.968081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.968263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.968464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.968631 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.968788 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.968937 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.969101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.969252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.969399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.969555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.969705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.969864 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.970067 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.970226 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.970375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.970535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.970694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.970852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.971010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.971161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.971893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.972061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.972224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.972421 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.972580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.972729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.972879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973053 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.973955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.974103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.974261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.974430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.974707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.974906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.975100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.975297 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.975496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.975681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.975866 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.976050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.976240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.976555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.976745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.976937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.977123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.977307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.977499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.977696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.977893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.978061 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.978311 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.978482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.978646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.978875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979186 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979795 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.979952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.980114 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.980270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.980442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.980605 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.980755 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.980902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981207 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981671 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981826 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.981986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.982455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.982455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.982904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.982904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.983199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.983351 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.983500 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.983657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.983813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.983973 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.984124 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.984124 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.984124 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.984124 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.984756 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.984906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985212 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985380 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985530 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985678 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.985974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.986129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.986613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.986766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.986916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.987064 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.987227 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.987390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.987549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.987698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.987853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.988983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.989142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.989299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.989467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.989618 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.989767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.989935 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.990861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.991168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.991316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.991463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.991610 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.991759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.991915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.992072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.992220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.992393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.992558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.992708 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.992868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993627 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.993784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.994212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.994360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.994534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.994698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.994856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.995940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.996090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.996238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.996527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.996712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.996864 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.997015 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.997173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.997322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.997480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.997630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.997825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998067 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998067 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998679 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998984 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.998984 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.999276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.999426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.999581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.999731 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.999884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:09.999884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.000192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.000360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.000516 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.000686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.000837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.000986 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.001143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.001299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.001455 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.001604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.001753 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.001912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.002069 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.002226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.002383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.002549 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.002699 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.002860 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003451 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003599 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003756 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.003905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.004053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.004238 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.004473 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.004640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.004793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.004952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.005101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.005256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.005420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.005577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.005727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.005876 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006024 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006340 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006497 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006647 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.006958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.007114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.007272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.007422 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.007571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.007719 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.007867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.010796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.010996 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.011158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.011312 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.011464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.011636 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.011967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.012138 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.012298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.012526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.012681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.012831 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.012990 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.013152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.013828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.013992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.014150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.014300 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.014663 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.014827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.014993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.015210 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.015375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.015536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.015698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.015862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.016162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.016325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.016325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.016963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.016963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.016963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.017403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.017559 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.017708 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.017870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.018021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.018179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.018363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.018634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.018816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.018978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.019128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.019277 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.019426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.019581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.019811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.019973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.020123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.020271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.020468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.020635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.020797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.020797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.021131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.021131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.021669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.021827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.021990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.022143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.022298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.022447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.022602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.022760 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.022921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.023078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.023236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.023393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.023543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.023705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.023856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024004 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024153 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024663 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.024972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.025121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.025270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.025418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.025578 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.025728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.025885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026042 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.026989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027205 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027338 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027515 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027616 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027792 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027866 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.027999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028230 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.028680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.029377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.029538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.029700 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.029916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.030072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.030228 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.030399 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.030570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.030729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.030885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031351 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031650 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.031946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.032102 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.032265 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.032460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.032622 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.032779 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.032929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.033135 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.033291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.033441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.033591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.033740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.033896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.034054 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.034206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.034363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.034528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.034686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.034843 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.035886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.036043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.036192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.036403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.036558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.036558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.036901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.037994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.038151 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.038300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.038467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.038625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.038776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.038925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.039081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.039230 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.039385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.039547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.039760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.039923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.040074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.040222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.040418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.040575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.040724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.040872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041175 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.041933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.042083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.042243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.042410 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.042560 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.042708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.042857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043014 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043327 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043484 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043947 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.043947 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.044271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.044457 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.044457 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.045267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.045430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.045581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.045729 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.045884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.046033 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.046221 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.046378 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.046554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.046730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.046881 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.047085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.047251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.047401 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.047550 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.047697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.047853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.048002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.048163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.048320 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.048500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.048661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.048839 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.049073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.049233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.049384 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.049540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.049696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.049852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050621 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050781 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.050942 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.051095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.051243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.051391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.051540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.051715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.051973 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.052151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.052304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.052528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.052680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.052841 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053002 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053765 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.053765 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.054059 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.054215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.054373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.054532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.054691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.054859 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.055995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.056143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.056291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.056479 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.056677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.056834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.057037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.057234 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.057392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.057550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.057702 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.057858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058007 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058509 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.058973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.059133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.059331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.059482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.059631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.059789 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.059939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.060095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.060327 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.060537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.060724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.060883 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061047 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061673 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.061972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.062128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.062290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.062441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.062596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.062745 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.062901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.063059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.063220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.063374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.063532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.063682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.063837 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.064054 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.064219 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.064392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.064548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.064803 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.064960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.065135 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.065302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.065470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.065757 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.065912 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.066144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.066306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.066462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.066619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.066768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.066916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.067116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.067281 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.067432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.067593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.067743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.067900 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.068058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.068218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.068440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.068608 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.068771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.068935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.069093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.069251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.069400 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.069555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.069714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.069872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070022 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070171 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.070953 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.071102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.071268 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.071420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.071586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.071749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.071905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.072055 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.072203 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.072382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.072630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.072790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.072952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.073104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.073290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.073454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.073625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.073773 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.073933 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125811) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 14:40:10.082516 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.082911 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.083264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.083631 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.084253 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.084642 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.085005 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.085359 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.085693 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.086041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.086389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.086759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.087092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.087457 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.087802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.088132 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.088489 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.089207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 20 14:40:10.089468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=125810) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 20 14:40:10.139098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO dbcounter [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Registered counter for database nova_api Oct 20 14:40:10.155096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Registered counter for database nova_api Oct 20 14:40:10.159884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_db.sqlalchemy.engines [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.166510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writer thread running {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.176011 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.182563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.224035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.context [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed54df7a-e597-4093-8f8e-592e2d1a176d(cell1) {{(pid=125811) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 14:40:10.228018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:40:10.228554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:40:10.230130 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:40:10.230863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:40:10.231317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:40:10.233878 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:40:10.235861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO dbcounter [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Registered counter for database nova_cell0 Oct 20 14:40:10.240186 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO dbcounter [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Registered counter for database nova_cell1 Oct 20 14:40:10.240314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.context [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),ed54df7a-e597-4093-8f8e-592e2d1a176d(cell1) {{(pid=125810) load_cells /opt/stack/nova/nova/context.py:464}} Oct 20 14:40:10.244329 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:40:10.244840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:40:10.246432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:40:10.247183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:40:10.247634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:40:10.248395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_db.sqlalchemy.engines [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.250046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_db.sqlalchemy.engines [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.250519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:40:10.252584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Registered counter for database nova_cell0 Oct 20 14:40:10.256099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writer thread running {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.256747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Registered counter for database nova_cell1 Oct 20 14:40:10.258414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writer thread running {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.264012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.267772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.270791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.407544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO dbcounter [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Registered counter for database nova_cell0 Oct 20 14:40:10.412977 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.414284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_db.sqlalchemy.engines [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125811) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.418692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writer thread running {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.423018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO dbcounter [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Registered counter for database nova_cell0 Oct 20 14:40:10.429797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_db.sqlalchemy.engines [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=125810) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 20 14:40:10.434119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writer thread running {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 20 14:40:10.741508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: WARNING keystonemiddleware.auth_token [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:40:10.748989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: WARNING keystonemiddleware.auth_token [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:40:10.753243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:40:10.760644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:40:11.097968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: WARNING keystonemiddleware.auth_token [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:40:11.103876 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: WARNING keystonemiddleware.auth_token [None req-3086e53c-c1c6-4d75-81cf-d4fcd74a305e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:40:11.109285 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621f9b479c0 pid: 125811 (default app) Oct 20 14:40:11.109577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 20 14:40:11.115989 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: WARNING keystonemiddleware.auth_token [None req-dcde3dab-be68-44c1-9719-7895c392e5c0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 20 14:40:11.121344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5621f9b479c0 pid: 125810 (default app) Oct 20 14:40:47.379111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:47.380572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:47.381919 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:47.382650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:48.965342 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-69a17ae4-6f53-4ce0-a557-7e3bde93fe43 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Action: 'create', calling method: .version_select at 0x7f6345d99b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-633199480"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:40:50.460604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-69a17ae4-6f53-4ce0-a557-7e3bde93fe43 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.090441 Oct 20 14:40:50.462904 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1155 bytes} [Thu Oct 20 14:40:47 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3094 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 20 14:40:50.508930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-79684f13-8c06-4179-9c41-a2936b495b14 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c739d0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:50.600993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-79684f13-8c06-4179-9c41-a2936b495b14 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/1b1635a3-485e-4775-8e57-047ba73050d4" status: 200 len: 350 microversion: 2.1 time: 0.101426 Oct 20 14:40:50.602121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 2/2] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:50 2022] GET /compute/v2.1/os-volumes/1b1635a3-485e-4775-8e57-047ba73050d4 => generated 350 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:40:50.904077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f371b429-1f15-45eb-ad46-57fa12475256 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345e4e700>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:50.939772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:50.939772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:50.939772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:50.939772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:40:51.503649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f371b429-1f15-45eb-ad46-57fa12475256 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1" status: 200 len: 345 microversion: 2.1 time: 1.027835 Oct 20 14:40:51.504307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 1/3] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:50 2022] GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 => generated 345 bytes in 1030 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:51.518437 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-896b5339-454b-4d6d-a264-26f5e3e708d0 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Action: 'create', calling method: .version_select at 0x7f6345c080d0>, body: {"snapshot": {"volume_id": "ab32a238-5dec-42e6-a6af-74d7ea5bafb1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1699796671"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:40:51.824608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-896b5339-454b-4d6d-a264-26f5e3e708d0 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.309818 Oct 20 14:40:51.831451 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 3/4] 10.222.0.13 () {60 vars in 1162 bytes} [Thu Oct 20 14:40:51 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:51.846447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-554a9e16-5ac5-48b3-8318-3c6f61c4e080 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345ca4a60>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:52.074792 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-554a9e16-5ac5-48b3-8318-3c6f61c4e080 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 200 len: 287 microversion: 2.1 time: 0.237437 Oct 20 14:40:52.082376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 2/5] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:51 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 287 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:52.089168 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8b918202-f07b-41c4-a53b-53f690dd7088 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c0e280>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:52.148829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8b918202-f07b-41c4-a53b-53f690dd7088 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.065419 Oct 20 14:40:52.150522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1140 bytes} [Thu Oct 20 14:40:52 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:40:52.155906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e90cd670-33b8-494b-b9c3-e6e2de1ac261 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345ca4af0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:52.162550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-228c4d7a-1d8a-480f-8c51-c0231568fde9 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c08040>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:52.199867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-228c4d7a-1d8a-480f-8c51-c0231568fde9 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 200 len: 287 microversion: 2.1 time: 0.040720 Oct 20 14:40:52.201008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 5/7] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:52 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:40:52.217776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e90cd670-33b8-494b-b9c3-e6e2de1ac261 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/331ce315-5348-485d-97bd-13953ccb7c6b" status: 200 len: 350 microversion: 2.1 time: 0.065928 Oct 20 14:40:52.218708 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 3/8] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:52 2022] GET /compute/v2.1/os-volumes/331ce315-5348-485d-97bd-13953ccb7c6b => generated 350 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:53.215891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b4dcdc18-1a95-41b8-b83a-8f9b669c4868 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c73a60>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:53.283876 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b4dcdc18-1a95-41b8-b83a-8f9b669c4868 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 200 len: 287 microversion: 2.1 time: 0.073153 Oct 20 14:40:53.291145 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 6/9] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:53 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 287 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:54.311613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fe1d5dbe-a840-44ae-9a52-95172e5801e2 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c731f0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:54.442912 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fe1d5dbe-a840-44ae-9a52-95172e5801e2 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 200 len: 287 microversion: 2.1 time: 0.143362 Oct 20 14:40:54.446492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 4/10] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:54 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 287 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:55.333196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b1d58230-986a-4473-b3f3-70221649a171 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c0e1f0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:55.459564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bb18694b-e1a1-471d-98bd-7e378d7a9b2d tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c73940>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:55.484271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b1d58230-986a-4473-b3f3-70221649a171 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/00f4904d-b9bc-43c2-8eda-f6a28117a892" status: 200 len: 350 microversion: 2.1 time: 0.155799 Oct 20 14:40:55.493390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 7/11] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:55 2022] GET /compute/v2.1/os-volumes/00f4904d-b9bc-43c2-8eda-f6a28117a892 => generated 350 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:40:55.499191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4b48b861-577f-4f4a-8576-55f02a258c67 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c73a60>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:55.544454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bb18694b-e1a1-471d-98bd-7e378d7a9b2d tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 200 len: 288 microversion: 2.1 time: 0.089134 Oct 20 14:40:55.556638 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 5/12] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:55 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 288 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:40:55.564490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-faadedd0-7c8a-49db-a1a6-6a046368dd86 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345bfd040>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:55.672621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4b48b861-577f-4f4a-8576-55f02a258c67 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.177860 Oct 20 14:40:55.673196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 8/13] 10.222.0.13 () {58 vars in 1134 bytes} [Thu Oct 20 14:40:55 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:40:55.690634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-80767aec-e5ed-4ff6-b1e4-e56d92a680fc tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c0e310>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:55.720760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-faadedd0-7c8a-49db-a1a6-6a046368dd86 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 202 len: 0 microversion: 2.1 time: 0.162659 Oct 20 14:40:55.721587 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 6/14] 10.222.0.13 () {58 vars in 1254 bytes} [Thu Oct 20 14:40:55 2022] DELETE /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:40:55.730189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c48bdecc-dcdc-4407-abaf-1c5de11fd4ac tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c73e50>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:55.791903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c48bdecc-dcdc-4407-abaf-1c5de11fd4ac tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 200 len: 287 microversion: 2.1 time: 0.065466 Oct 20 14:40:55.793370 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 7/15] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:55 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:55.926876 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-80767aec-e5ed-4ff6-b1e4-e56d92a680fc tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.240375 Oct 20 14:40:55.927944 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 9/16] 10.222.0.13 () {58 vars in 1149 bytes} [Thu Oct 20 14:40:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:40:55.947440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6e41a99f-750e-42d0-80bd-178df13cb056 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c73700>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:56.151939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6e41a99f-750e-42d0-80bd-178df13cb056 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.209750 Oct 20 14:40:56.153368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 8/17] 10.222.0.13 () {58 vars in 1134 bytes} [Thu Oct 20 14:40:55 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:40:56.169856 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-61674574-c60d-405f-9f6f-6c465b34d936 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c0ed30>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:56.432239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-61674574-c60d-405f-9f6f-6c465b34d936 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.268007 Oct 20 14:40:56.432907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 10/18] 10.222.0.13 () {58 vars in 1167 bytes} [Thu Oct 20 14:40:56 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:56.450489 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bba4a51e-6e5c-43b2-82ef-a8ec5a2f1c05 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c73af0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:56.805826 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b13a527d-f029-4ccb-a786-545f00f5c3e6 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c73c10>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:56.820752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bba4a51e-6e5c-43b2-82ef-a8ec5a2f1c05 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.376456 Oct 20 14:40:56.822103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 9/19] 10.222.0.13 () {58 vars in 1170 bytes} [Thu Oct 20 14:40:56 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:56.837209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8de4f648-5429-4116-8c03-271c3a0b5096 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c7ad30>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:56.862390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-b13a527d-f029-4ccb-a786-545f00f5c3e6 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] HTTP exception thrown: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b13a527d-f029-4ccb-a786-545f00f5c3e6 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Request method failure captured: Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb HTTP/1.1 Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV3v92ky83Gci_8-IfZBknhn06R214PbDKKAPkk90jyuJ8lbd0QGBsE_Go1Tyl_2yEzkI1Fdc7rDiCUhrTpxwPZxtgc8C68XhdVCHTX83BmSxqLnJOzEvIq94jPHAb4fekjoDMpyyaqO8K4iLWPWfmOQaaFKozr5VTPetcdpMvsDoPM Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:40:56.866785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: f14f13f618ac44e9a1f463be2852b368 Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '18d6c78e-7e69-4d43-ab3a-1de602721afb'} Oct 20 14:40:56.868474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. (HTTP 404) (Request-ID: req-7fbb1047-d27d-467f-b91e-93cd7d05a473) Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.869476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:40:56.871455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 20 14:40:56.872895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:56.874353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b13a527d-f029-4ccb-a786-545f00f5c3e6 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Returning 404 to user: Snapshot 18d6c78e-7e69-4d43-ab3a-1de602721afb could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:40:56.886316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b13a527d-f029-4ccb-a786-545f00f5c3e6 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb" status: 404 len: 111 microversion: 2.1 time: 0.081904 Oct 20 14:40:56.894798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 11/20] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:40:56 2022] GET /compute/v2.1/os-snapshots/18d6c78e-7e69-4d43-ab3a-1de602721afb => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:40:56.918276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fc7aa698-c6bc-45c6-bdc3-7390872de4f1 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c149d0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:57.050851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8de4f648-5429-4116-8c03-271c3a0b5096 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.217487 Oct 20 14:40:57.052036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 10/21] 10.222.0.13 () {58 vars in 1155 bytes} [Thu Oct 20 14:40:56 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:40:57.066927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-30bf7052-6a36-423a-b98a-78f96380f47d tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c7ab80>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:57.096982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fc7aa698-c6bc-45c6-bdc3-7390872de4f1 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1" status: 202 len: 0 microversion: 2.1 time: 0.200947 Oct 20 14:40:57.100974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 12/22] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:40:56 2022] DELETE /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 => generated 0 bytes in 205 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:40:57.106837 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-70ba7c4e-ad6a-4da3-9a9e-351b3a6201aa tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c144c0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:57.251602 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-70ba7c4e-ad6a-4da3-9a9e-351b3a6201aa tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1" status: 200 len: 344 microversion: 2.1 time: 0.149090 Oct 20 14:40:57.259484 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 13/23] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:57 2022] GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:57.274504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-30bf7052-6a36-423a-b98a-78f96380f47d tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.211581 Oct 20 14:40:57.275495 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 11/24] 10.222.0.13 () {58 vars in 1188 bytes} [Thu Oct 20 14:40:57 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:40:57.293851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cc031b4c-8b45-4d90-a3f9-0b0c4f6c0b84 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] Calling method '.version_select at 0x7f6345c14d30>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:57.523614 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cc031b4c-8b45-4d90-a3f9-0b0c4f6c0b84 tempest-VolumesTestJSON-496700360 tempest-VolumesTestJSON-496700360-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.238164 Oct 20 14:40:57.525998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 14/25] 10.222.0.13 () {58 vars in 1155 bytes} [Thu Oct 20 14:40:57 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:40:58.268140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-950e2328-d203-4423-b860-7f8f2004ec8f tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c73790>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:58.362188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-950e2328-d203-4423-b860-7f8f2004ec8f tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] HTTP exception thrown: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-950e2328-d203-4423-b860-7f8f2004ec8f tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Request method failure captured: Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 HTTP/1.1 Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV3v92ky83Gci_8-IfZBknhn06R214PbDKKAPkk90jyuJ8lbd0QGBsE_Go1Tyl_2yEzkI1Fdc7rDiCUhrTpxwPZxtgc8C68XhdVCHTX83BmSxqLnJOzEvIq94jPHAb4fekjoDMpyyaqO8K4iLWPWfmOQaaFKozr5VTPetcdpMvsDoPM Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:40:58.367696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: f14f13f618ac44e9a1f463be2852b368 Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'ab32a238-5dec-42e6-a6af-74d7ea5bafb1'} Oct 20 14:40:58.369280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. (HTTP 404) (Request-ID: req-c1d657b1-f43a-41f1-a8b2-813db109e418) Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.370130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:40:58.371907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 14:40:58.373172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.374377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.376579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-950e2328-d203-4423-b860-7f8f2004ec8f tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Returning 404 to user: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:40:58.377778 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-950e2328-d203-4423-b860-7f8f2004ec8f tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1" status: 404 len: 109 microversion: 2.1 time: 0.114349 Oct 20 14:40:58.380639 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 12/26] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:58 2022] GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 => generated 109 bytes in 118 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:40:58.399925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-63f24d27-4623-4b26-9c06-1036780cc826 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345c14670>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:58.452147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-63f24d27-4623-4b26-9c06-1036780cc826 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] HTTP exception thrown: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-63f24d27-4623-4b26-9c06-1036780cc826 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Request method failure captured: Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 HTTP/1.1 Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV3v92ky83Gci_8-IfZBknhn06R214PbDKKAPkk90jyuJ8lbd0QGBsE_Go1Tyl_2yEzkI1Fdc7rDiCUhrTpxwPZxtgc8C68XhdVCHTX83BmSxqLnJOzEvIq94jPHAb4fekjoDMpyyaqO8K4iLWPWfmOQaaFKozr5VTPetcdpMvsDoPM Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:40:58.461427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: f14f13f618ac44e9a1f463be2852b368 Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'ab32a238-5dec-42e6-a6af-74d7ea5bafb1'} Oct 20 14:40:58.462747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. (HTTP 404) (Request-ID: req-e8c26bfc-d46d-4c8a-b67c-cd88708cc331) Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.463522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 14:40:58.466588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 14:40:58.469976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-63f24d27-4623-4b26-9c06-1036780cc826 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Returning 404 to user: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-63f24d27-4623-4b26-9c06-1036780cc826 tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1" status: 404 len: 109 microversion: 2.1 time: 0.070419 Oct 20 14:40:58.476824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 15/27] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:40:58 2022] DELETE /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 => generated 109 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:40:58.485325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ff4d5b9b-c006-4e1d-93fe-3adf8ed7d4fe tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Calling method '.version_select at 0x7f6345bfed30>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:40:58.534954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-ff4d5b9b-c006-4e1d-93fe-3adf8ed7d4fe tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] HTTP exception thrown: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ff4d5b9b-c006-4e1d-93fe-3adf8ed7d4fe tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Request method failure captured: Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 HTTP/1.1 Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV3v92ky83Gci_8-IfZBknhn06R214PbDKKAPkk90jyuJ8lbd0QGBsE_Go1Tyl_2yEzkI1Fdc7rDiCUhrTpxwPZxtgc8C68XhdVCHTX83BmSxqLnJOzEvIq94jPHAb4fekjoDMpyyaqO8K4iLWPWfmOQaaFKozr5VTPetcdpMvsDoPM Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:40:58.538412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/22dfe6d702cb4ad690238da1a6c20163"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 22dfe6d702cb4ad690238da1a6c20163 Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-288797996 Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: f14f13f618ac44e9a1f463be2852b368 Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotsTestJSON-288797996-project Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'ab32a238-5dec-42e6-a6af-74d7ea5bafb1'} Oct 20 14:40:58.540102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. (HTTP 404) (Request-ID: req-ba21449c-806e-4568-90a7-ffd04923ad14) Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.541057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:40:58.542411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 14:40:58.544077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. Oct 20 14:40:58.552461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:40:58.555866 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ff4d5b9b-c006-4e1d-93fe-3adf8ed7d4fe tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] Returning 404 to user: Volume ab32a238-5dec-42e6-a6af-74d7ea5bafb1 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:40:58.557307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ff4d5b9b-c006-4e1d-93fe-3adf8ed7d4fe tempest-VolumesSnapshotsTestJSON-288797996 tempest-VolumesSnapshotsTestJSON-288797996-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1" status: 404 len: 109 microversion: 2.1 time: 0.085388 Oct 20 14:40:58.559119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 13/28] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:40:58 2022] GET /compute/v2.1/os-volumes/ab32a238-5dec-42e6-a6af-74d7ea5bafb1 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:41:02.206154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-816991138", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "networks": [{"uuid": "d774747b-7777-4bbe-9570-71c987a7b55a"}]}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:02.548030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] validate_networks() for [('d774747b-7777-4bbe-9570-71c987a7b55a', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:41:05.590545 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:41:05.591805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:41:05.592467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:41:05.593098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:41:05.593666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:41:05.638509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:05.642030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:05.643393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:05.644326 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:05.646337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:05.646922 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:05.735308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Getting quotas for project 201aed13c0e342f5b30286ce3f82eb82. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:05.754836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Getting quotas for user 812daba513084a55badecfcde843a6ff and project 201aed13c0e342f5b30286ce3f82eb82. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:05.789259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:41:05.798886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:41:05.904757 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c0e465df-a15f-4de6-b42b-c92adf5c2ccd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: .version_select at 0x7f6345c7a700>, body: {"keypair": {"name": "tempest-keypair-1411788643", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGbbszVy1KLUY84Xk6ETsWCBsiabUY3lzBB9n3l5IQWTFHPm8oJ2DPoN8SUmYs6CsA+1zZnRqg829PGdicMlSP7p3TYht25+1BTG/NK7qFLmfdTcc7rRUsxe4Db7YDqong=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:05.987713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0fa7fa95-3d94-4ecc-ac7a-2e7485f930b6 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.168669 Oct 20 14:41:05.993074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 16/29] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:41:01 2022] POST /compute/v2.1/servers => generated 380 bytes in 4175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:41:06.022136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-c0e465df-a15f-4de6-b42b-c92adf5c2ccd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:06.032394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-c0e465df-a15f-4de6-b42b-c92adf5c2ccd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:06.117936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c0e465df-a15f-4de6-b42b-c92adf5c2ccd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.661637 Oct 20 14:41:06.130289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 14/30] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:41:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:06.137860 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00a23cd1-7051-4a3c-8c8e-bc5e6e174096 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:06.139072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-00a23cd1-7051-4a3c-8c8e-bc5e6e174096 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:06.333442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-00a23cd1-7051-4a3c-8c8e-bc5e6e174096 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:06.372617 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f28efe00-f29d-41a2-b191-67ff14c423ba tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'create', calling method: .version_select at 0x7f63452844c0>, body: {"keypair": {"name": "tempest-keypair-1703811471", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEZjeHq08U4wBsQJOxXY4yQublVn1pSvt6eFPJlfSvcfPZd355U2X3adMMduFtDyI/KdK5/qMoTRX0OipmbtCMmnc+gPQjrtdPOvIHkY8FfJVxBCC45YloaUZIF4bEWBHg=="}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:06.378564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-00a23cd1-7051-4a3c-8c8e-bc5e6e174096 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1214 microversion: 2.1 time: 0.240124 Oct 20 14:41:06.379217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 15/31] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:06 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1214 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:06.439138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-f28efe00-f29d-41a2-b191-67ff14c423ba tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for project afd56c15beff4515a44799ee7ec083a3. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:06.446917 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-f28efe00-f29d-41a2-b191-67ff14c423ba tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for user 9fc72f6965bb4814a5d85bd04769e4cb and project afd56c15beff4515a44799ee7ec083a3. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:06.527452 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f28efe00-f29d-41a2-b191-67ff14c423ba tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.531954 Oct 20 14:41:06.528589 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 17/32] 10.222.0.13 () {62 vars in 1200 bytes} [Thu Oct 20 14:41:05 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 535 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 20 14:41:07.408200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e50e8ab4-4b71-496a-838c-18f944b6c230 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:07.409209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e50e8ab4-4b71-496a-838c-18f944b6c230 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:07.673726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e50e8ab4-4b71-496a-838c-18f944b6c230 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:07.684724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e50e8ab4-4b71-496a-838c-18f944b6c230 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1214 microversion: 2.1 time: 0.281656 Oct 20 14:41:07.688236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 16/33] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:07 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1214 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:08.380620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ef9baaba-fbe4-4c24-aded-1bce01e4b9cd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: .version_select at 0x7f634529c550>, body: {"keypair": {"name": "tempest-keypair-499372789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE/uMjCx6L/wxOvCJ5GhWXkBVos0ocDyv1sT+LgOjbLS/Y7lAnnjMP753b39udc7R2CSH0xGFQtlEFmBLp2AerBlKzXzAeEDurpXHMqFfBbXbjNyzMP7dGdsTBpPcW8wwg=="}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:08.425188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-ef9baaba-fbe4-4c24-aded-1bce01e4b9cd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for project a3d7fadfead1456792446f71c465bc0c. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:08.438823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-ef9baaba-fbe4-4c24-aded-1bce01e4b9cd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for user 4d74d7fd62cd464183f9df4ca581833c and project a3d7fadfead1456792446f71c465bc0c. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:08.524763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ef9baaba-fbe4-4c24-aded-1bce01e4b9cd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.024326 Oct 20 14:41:08.536999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 18/34] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:41:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:08.718278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:08.718972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:08.731556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:08.732306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:08.734376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:08.737940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:08.738737 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:08.739857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:09.139046 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:09.162000 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-96fd6600-7d2a-48fa-8d6a-eb479cab7302 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1210 microversion: 2.1 time: 0.448484 Oct 20 14:41:09.178935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 17/35] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:08 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1210 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:10.214762 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:10.217752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:10.309567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:10.313887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:10.314545 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:10.324581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:10.327088 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:10.328487 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:11.181676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:11.214593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-871bd024-893b-4253-9fa6-14406d945725 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1272 microversion: 2.1 time: 1.023033 Oct 20 14:41:11.218484 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 19/36] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:10 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1272 bytes in 1029 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:12.251640 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:12.253702 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:12.297247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:12.297874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:12.300262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:12.333398 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:12.334603 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:12.337620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:13.571256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:13.607110 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-268c46ec-0f37-40ad-bfd9-42e0d7e71c65 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 1.364404 Oct 20 14:41:13.621995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 18/37] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:12 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 1372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:14.405188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-516085127", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc51d155-90b9-48b7-86e9-fc4346955e9e"}], "security_groups": [{"name": "tempest-securitygroup--710788097"}], "key_name": "tempest-keypair-1411788643", "user_data": "}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:14.636466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:14.639212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:14.650023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:14.651849 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:14.652591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:14.661279 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:14.661855 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:14.662301 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:14.974724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] validate_networks() for [('bc51d155-90b9-48b7-86e9-fc4346955e9e', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:41:15.678906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:17.072422 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:17.086202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-011063b3-698d-4916-9e5d-17880956c94e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 2.453583 Oct 20 14:41:17.087302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 19/38] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:14 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 2456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:17.095721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1543808873", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8527c204-ec5a-42a2-811a-426241f609de"}], "security_groups": [{"name": "tempest-securitygroup--1659248675"}], "key_name": "tempest-keypair-1703811471", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:17.119669 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:41:17.121441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:41:17.122241 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:41:17.122959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:41:17.123508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:41:17.139854 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:17.143053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:17.143653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:17.144608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:17.146657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:17.147246 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:17.193580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:17.202776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:17.211269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:41:17.216048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:41:17.293776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7cbd6040-1d5b-47d2-a7a0-05ea796b72e0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.894081 Oct 20 14:41:17.301189 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:41:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 2896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:41:17.308642 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-852517225", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc293b8c-746d-49c9-a6cf-e8d38b9a4352"}], "security_groups": [{"name": "tempest-securitygroup--715512877"}], "key_name": "tempest-keypair-499372789", "user_data": "}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:17.487017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] validate_networks() for [('8527c204-ec5a-42a2-811a-426241f609de', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:41:17.678657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=8 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:17.680089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] validate_networks() for [('fc293b8c-746d-49c9-a6cf-e8d38b9a4352', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:41:20.124831 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:41:20.127879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:41:20.132067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:41:20.132567 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:41:20.133021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:41:20.136131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:41:20.137278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:41:20.138337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:41:20.139699 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:41:20.140311 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:41:20.151761 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.152777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.154268 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.155419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.156245 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.156927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.171299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.171791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.172511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.173246 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.175741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.176383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.181740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for project a3d7fadfead1456792446f71c465bc0c. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:20.188088 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for user 4d74d7fd62cd464183f9df4ca581833c and project a3d7fadfead1456792446f71c465bc0c. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:20.211113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:41:20.214686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:41:20.219042 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for project afd56c15beff4515a44799ee7ec083a3. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:41:20.253380 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for user 9fc72f6965bb4814a5d85bd04769e4cb and project afd56c15beff4515a44799ee7ec083a3. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:41:20.312645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:41:20.328759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:41:20.380774 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-23389a59-5505-4a6d-a2cd-21f5470690de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.084397 Oct 20 14:41:20.382000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:41:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 3086 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:41:20.400323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:20.401960 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:20.430996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.431505 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.431962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.433264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.433769 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.434249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.585320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-66165a9d-9198-43ca-bbb5-804b19ccc9bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.495280 Oct 20 14:41:20.588104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 20/41] 10.222.0.13 () {62 vars in 1188 bytes} [Thu Oct 20 14:41:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 3500 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 20 14:41:20.606849 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:20.607490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:20.641063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.641904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.642377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.643166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:20.643640 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:20.644098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:20.703520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:20.718442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-23a8f143-29c9-466b-a865-3ee7c06af88c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1245 microversion: 2.1 time: 0.335078 Oct 20 14:41:20.718920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 22/42] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:20 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1245 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:20.743226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2e199aff-0a0f-417b-b3ac-2109d24fd4a1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:20.744266 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2e199aff-0a0f-417b-b3ac-2109d24fd4a1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:20.881520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:20.890085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0672ba5d-2c62-42f3-825f-0192d439cf1e tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.299070 Oct 20 14:41:20.890668 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 21/43] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:20 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:20.908291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-73c610c1-e53f-4858-ac37-5f2e745ec9f2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:20.910303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-73c610c1-e53f-4858-ac37-5f2e745ec9f2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:20.959235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2e199aff-0a0f-417b-b3ac-2109d24fd4a1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:21.002617 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-73c610c1-e53f-4858-ac37-5f2e745ec9f2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:21.007232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2e199aff-0a0f-417b-b3ac-2109d24fd4a1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1236 microversion: 2.1 time: 0.285811 Oct 20 14:41:21.007825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 23/44] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:20 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1236 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:21.023349 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-73c610c1-e53f-4858-ac37-5f2e745ec9f2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:21.031176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-73c610c1-e53f-4858-ac37-5f2e745ec9f2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:21.035549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-73c610c1-e53f-4858-ac37-5f2e745ec9f2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1282 microversion: 2.20 time: 0.135911 Oct 20 14:41:21.036557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:20 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1282 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:21.181040 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "64154415-88f0-466b-bef8-1382fdd67d44", "tag": "fc603914-32ae-4452-8f3a-d9500d71d5e5"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:21.238407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.240220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.243126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:21.308690 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Creating event network-changed:fc603914-32ae-4452-8f3a-d9500d71d5e5 for instance 64154415-88f0-466b-bef8-1382fdd67d44 on hv-cinder-77923 Oct 20 14:41:21.309216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 20 14:41:21.309655 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-76520496-fefe-4914-9acc-22aeb733a3a9 req-e5b0f9ec-2433-42c1-a759-ecec47c88ff8 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 20 14:41:21.310750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.339517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.028s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.339517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:21.340453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.340927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.341353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:21.375146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.compute.rpcapi [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 20 14:41:21.376165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] Releasing lock "compute-rpcapi-router" {{(pid=125811) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 20 14:41:21.421071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6223a441-79f8-4d79-a6eb-83e3fcd523a1 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.407166 Oct 20 14:41:21.426800 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 24/46] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:21.759910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:21.766141 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:21.777568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.778693 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.779363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:21.780591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.781192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.783151 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:21.911306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:21.918331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:21.924651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:21.930250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-72d25c9e-601d-4664-b20c-b908a9903d36 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1237 microversion: 2.1 time: 0.191775 Oct 20 14:41:21.935389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 23/47] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:21 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1237 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:21.943049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.943732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.944178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:21.945093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:21.945569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:21.945999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:22.035845 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:22.036896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:22.048062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:22.048589 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:22.049211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:22.050094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:22.050695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:22.051268 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:22.158741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:22.171188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a74cdc4f-81bc-467d-89e9-72d63faeb1f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1240 microversion: 2.1 time: 0.139709 Oct 20 14:41:22.172240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 24/48] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:22 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1240 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:22.177158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:22.178291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:22.203390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:22.204273 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:22.204912 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:22.205829 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:22.206436 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:22.207028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:22.322035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:22.338141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ed82dd25-3380-4db5-8404-13300c1d756f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.422633 Oct 20 14:41:22.342314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 25/49] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:21 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:22.416816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:22.450706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:22.454270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:22.460502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ac51e813-6ab3-411b-b561-aea9cc6c5bdc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1286 microversion: 2.20 time: 0.286908 Oct 20 14:41:22.462106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:22 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1286 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:22.961994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:22.963161 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:22.972134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:22.973602 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:22.974196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:22.976782 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:22.980132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:22.981049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.067805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:23.081904 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0de15918-0cc5-4429-abc6-8c59aad44fda tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1237 microversion: 2.1 time: 0.126074 Oct 20 14:41:23.083055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 26/51] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:22 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1237 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:23.203277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:23.203905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:23.233962 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:23.234823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:23.235769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.236791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:23.237444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:23.238140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.339929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:23.349629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e44c1096-8ae9-440d-8c25-90308cda3300 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1240 microversion: 2.1 time: 0.156514 Oct 20 14:41:23.351364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 26/52] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:23 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1240 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:23.371520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:23.372571 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:23.382248 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:23.383022 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:23.383696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.386797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:23.387857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:23.388511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.489543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:23.490143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:23.500304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:23.500845 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:23.501295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.506465 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:23.508133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:23.510093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:23.628870 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:23.641690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:23.643100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:23.644251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1e2751cb-677c-434c-832c-83f73fa04b99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1286 microversion: 2.20 time: 0.159339 Oct 20 14:41:23.657396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 27/53] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:23 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1286 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:23.901836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:23.970459 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4a57d782-39f0-4895-97e5-1ad0448827d3 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.596473 Oct 20 14:41:23.979756 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 27/54] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:23 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:24.112820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:24.113686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:24.134539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:24.136983 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:24.139490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:24.142394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:24.142813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:24.149943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:24.323212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:24.337183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7f875eef-a192-47e7-adef-71b83d500d96 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1237 microversion: 2.1 time: 0.234296 Oct 20 14:41:24.344323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 28/55] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:24 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1237 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:24.380744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:24.382472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:24.400518 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:24.402005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:24.402640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:24.405420 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:24.406159 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:24.407732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:24.691820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:24.692596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:24.720545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:24.723527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:24.730578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:24.732552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:24.733739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:24.736271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:25.027361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:25.046717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-493815aa-7823-49c3-b011-ad74276c1901 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1232 microversion: 2.1 time: 0.671819 Oct 20 14:41:25.063197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 28/56] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:24 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1232 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:25.071591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:25.071591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:25.084701 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:25.085199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:25.085641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:25.086362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:25.086814 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:25.087240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:25.137856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:25.154873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:25.157920 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:25.159398 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7a88a9d-ee3e-4f9a-bad3-b2d56dc17a81 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1278 microversion: 2.20 time: 0.473337 Oct 20 14:41:25.160737 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 29/57] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:24 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1278 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:25.289171 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:25.298798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-146089ca-b364-4de3-99c1-72469eca5768 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.233837 Oct 20 14:41:25.300434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 29/58] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:25 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:25.368607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:25.369231 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:25.377813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:25.378177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:25.378553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:25.384900 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:25.385491 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:25.385940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:25.558519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:25.574517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e9b3119e-bc8d-488d-9da5-60f114cfeae1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1293 microversion: 2.1 time: 0.210390 Oct 20 14:41:25.575225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 30/59] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:25 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1293 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:26.083281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:26.084534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:26.094217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.094957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.095821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.096625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.097262 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.097851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.187943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:26.188595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:26.197325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.198358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.198814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.199523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.213841 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.214456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.458104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:26.473490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c84c55a7-8bb1-4f6a-bc62-92af7ef5a890 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1232 microversion: 2.1 time: 0.397118 Oct 20 14:41:26.476649 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 30/60] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:26 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1232 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:26.489435 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:26.502898 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:26.504985 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:26.506852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aae31118-2ef2-4d53-8310-0bb8d2a26578 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1334 microversion: 2.20 time: 0.322472 Oct 20 14:41:26.507425 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:26.508151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:26.508753 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 31/61] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:26 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1334 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:26.512150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=11 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:26.519177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.519962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.520656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.521750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.522416 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.523234 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.601588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:26.602299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:26.618092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.618989 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.621826 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.623973 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:26.625604 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:26.626268 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:26.728377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:26.738143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9581a8fb-181b-434c-9c95-fdcab5bd288f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1299 microversion: 2.1 time: 0.142061 Oct 20 14:41:26.741905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 32/62] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:26 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1299 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:26.749718 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:26.757730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-890fdee8-41fa-442e-9faa-1c9e1c144d88 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.257099 Oct 20 14:41:26.759149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 31/63] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:26 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:27.506342 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:27.507663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:27.514842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.515894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.516576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.517677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.518474 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.519074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.536600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:27.537968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:27.554393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.556651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.561557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.562742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.568499 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.568910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.587522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=65 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:27.649101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:27.658384 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cb6facc1-1322-4acc-8deb-5ac87027235d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1288 microversion: 2.1 time: 0.156546 Oct 20 14:41:27.672830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 33/64] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:27 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1288 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:27.771243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:27.772058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:27.788834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.790976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.792273 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.794223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.795623 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.796080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.870753 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:27.886660 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:27.888797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:27.907751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ab68d184-bb40-48e1-be02-9bc58cefd64e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1340 microversion: 2.20 time: 0.364343 Oct 20 14:41:27.908561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:27 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1340 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:41:27.916808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:27.917487 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:27.938114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.938598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.939209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:27.944577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:27.945645 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:27.946249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:28.050547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:28.059692 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aafaea32-d669-4738-afc0-9158dda62522 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.295289 Oct 20 14:41:28.065970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 34/66] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:27 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:28.230953 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:28.264226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-419313f9-bce7-4f7e-be7a-6dc18b34beb0 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.352839 Oct 20 14:41:28.282011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 33/67] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:27 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:28.683216 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:28.684600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:28.691262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:28.692049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:28.692740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:28.693672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:28.694346 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:28.695061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:28.700971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:28.800582 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:28.813373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b5ec67ce-2911-4d5f-9aa9-b58376982687 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1296 microversion: 2.1 time: 0.134337 Oct 20 14:41:28.814176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 35/68] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:28 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1296 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:28.939394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:28.944602 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:28.964588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:28.966431 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:28.967047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:28.971746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:28.972508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:28.973789 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.095727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:29.096778 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:29.108903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:29.114378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:29.115156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.116127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:29.124749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:29.128729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.471657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:29.480735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:29.482218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:29.483358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-254b1048-6cbf-4315-b950-baf7d773c8c8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.549802 Oct 20 14:41:29.496735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 34/69] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:28 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:29.508550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:29.509176 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:29.516109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:29.517379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:29.518003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.519050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:29.519653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:29.520224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.595006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:29.608899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a54679f3-c277-45d0-be55-457919d6480c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.513503 Oct 20 14:41:29.625256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 36/70] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:29 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:29.839101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:29.839714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:29.859854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:29.861665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:29.862218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.864401 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:29.864967 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:29.867044 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:29.919043 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:29.953031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c5db0d91-1c89-475c-a4bc-b8b5c5221c08 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.453487 Oct 20 14:41:29.955520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 35/71] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:29 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:30.043822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:30.055795 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bc9c84d4-9929-48f0-bf14-f3850333ca8e tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1294 microversion: 2.1 time: 0.218545 Oct 20 14:41:30.058657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 37/72] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:29 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1294 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:30.512382 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:30.513009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:30.519361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:30.520076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:30.520712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:30.521577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:30.522282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:30.522858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:30.634260 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:30.636944 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:30.643140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:30.645156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:30.645807 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:30.646752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:30.647690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:30.648285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:30.649002 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:30.867423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:30.878188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:30.881215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:30.881710 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1eb18b4e-616a-40b8-a6fd-e3efd7c4bf3b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.373290 Oct 20 14:41:30.891237 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 36/73] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:30 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:30.913160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:30.921453 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d936fc0a-4779-449e-b4a5-e1f99f70ac15 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.291461 Oct 20 14:41:30.922431 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 38/74] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:30 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:30.984507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:30.984984 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:30.997844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:30.998338 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:30.998771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.008333 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.009227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.009673 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.010293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=28 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:31.084990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:31.096333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:31.099013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=8 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:31.106315 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.107188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.109559 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.110966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.113602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.115294 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.357581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:31.396893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:31.402281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-eb8991b7-e0b6-472d-8ce7-4e489eecfa58 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.421835 Oct 20 14:41:31.411201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 37/75] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:30 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:31.647737 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:31.661200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9d25af10-9406-46c3-8aa0-5aa084b5cd25 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.581562 Oct 20 14:41:31.676913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-6f9ea44e-5f39-4ebb-9c1d-3cfc4a565cb8 req-ee3e39e6-02b2-4ec7-88a9-c1d05da00b8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8d0a95-894e-4244-9a27-6b86a1b5ca83", "tag": "516e6fb9-5c7c-44bb-b65b-facb0026c92b"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:31.677848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-6f9ea44e-5f39-4ebb-9c1d-3cfc4a565cb8 req-ee3e39e6-02b2-4ec7-88a9-c1d05da00b8a service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.678831 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 39/76] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:31 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:31.679507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-6f9ea44e-5f39-4ebb-9c1d-3cfc4a565cb8 req-ee3e39e6-02b2-4ec7-88a9-c1d05da00b8a service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.680374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-6f9ea44e-5f39-4ebb-9c1d-3cfc4a565cb8 req-ee3e39e6-02b2-4ec7-88a9-c1d05da00b8a service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.696423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-6f9ea44e-5f39-4ebb-9c1d-3cfc4a565cb8 req-ee3e39e6-02b2-4ec7-88a9-c1d05da00b8a service nova] Creating event network-changed:516e6fb9-5c7c-44bb-b65b-facb0026c92b for instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 on hv-cinder-77923 Oct 20 14:41:31.704174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-6f9ea44e-5f39-4ebb-9c1d-3cfc4a565cb8 req-ee3e39e6-02b2-4ec7-88a9-c1d05da00b8a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.133038 Oct 20 14:41:31.705511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 38/77] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:41:31.925470 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:31.929354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:31.941743 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.943940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.944629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.948553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.949402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:31.950121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.950474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:31.951035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.972659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.974554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.975974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:31.980264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:31.981206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:31.982323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:32.488213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:32.501028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:32.508000 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:32.509229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-91401956-828b-4a74-a1b4-4db194f43c0f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.600756 Oct 20 14:41:32.521722 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 40/78] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:31 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:32.535643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:32.536534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:32.538599 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:32.544430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:32.545098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:32.545701 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:32.546541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:32.547129 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:32.547869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:32.552811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-191053ef-2b91-4364-b155-55de5fb008d4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.607401 Oct 20 14:41:32.569331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 39/79] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:31 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:32.689004 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:32.689640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:32.707773 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:32.709029 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:32.709526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:32.710845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:32.711594 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:32.712258 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:32.872232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:32.885367 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-531bfe2d-780f-4b4b-ba8e-34808ce6bb1c tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.361187 Oct 20 14:41:32.887399 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 41/80] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:32 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:32.966062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c72900-27b7-470e-9d95-752506e689ad", "tag": "113928f5-c90e-4f91-8207-0c0a6f2d414b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:33.009338 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.012719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.015486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.060285 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:33.099193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Creating event network-changed:113928f5-c90e-4f91-8207-0c0a6f2d414b for instance 38c72900-27b7-470e-9d95-752506e689ad on hv-cinder-77923 Oct 20 14:41:33.105383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=125810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 20 14:41:33.110008 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-45b5a7ad-e4a6-43be-997d-c16fb87dbd10 req-cc528819-215b-41fa-8893-a6cba6c0f999 service nova] Acquired lock "compute-rpcapi-router" {{(pid=125810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 20 14:41:33.115376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.116158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.116902 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.125892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.129246 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.130088 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.130263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2699c256-ed40-4987-a537-58626676d71c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.445661 Oct 20 14:41:33.138454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 40/81] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:32 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:33.161065 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.compute.rpcapi [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 20 14:41:33.162245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] Releasing lock "compute-rpcapi-router" {{(pid=125810) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 20 14:41:33.204662 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-92e55c86-da3b-4762-8474-8f4c9ddfdb16 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240904 Oct 20 14:41:33.205335 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 42/82] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:41:33.540027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:33.540766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:33.549274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.549898 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.550589 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.551470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.552224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.552937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.585927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:33.588272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:33.599875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.601247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.602256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.603491 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.604278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.606159 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.779813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:33.792640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:33.794367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:33.795554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1327fbf4-f00e-4156-a559-0cfe1bb8f65e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.259967 Oct 20 14:41:33.796157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 41/83] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:33 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:33.823503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-81a805be-22cd-4510-b392-a29684d8ad1e req-0ae4424b-2649-4e71-9207-e415e0c49c22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:33.824696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:33.834483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3bce0e2a-ebb6-4368-bbe6-3294c6d61a71 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.254975 Oct 20 14:41:33.835463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 43/84] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:33 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:33.838790 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-81a805be-22cd-4510-b392-a29684d8ad1e req-0ae4424b-2649-4e71-9207-e415e0c49c22 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.839327 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-81a805be-22cd-4510-b392-a29684d8ad1e req-0ae4424b-2649-4e71-9207-e415e0c49c22 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.839721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-81a805be-22cd-4510-b392-a29684d8ad1e req-0ae4424b-2649-4e71-9207-e415e0c49c22 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.852150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-81a805be-22cd-4510-b392-a29684d8ad1e req-0ae4424b-2649-4e71-9207-e415e0c49c22 service nova] Creating event network-changed:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:41:33.859043 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-81a805be-22cd-4510-b392-a29684d8ad1e req-0ae4424b-2649-4e71-9207-e415e0c49c22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059929 Oct 20 14:41:33.859635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 42/85] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:33.914096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:33.914722 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:33.921258 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.921724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.922166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:33.922844 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:33.923302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:33.923741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:34.085867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:34.095029 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7696b99b-8556-4f0f-a949-a234fdba9d78 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.184847 Oct 20 14:41:34.095867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 44/86] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:33 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:34.163288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:34.164031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:34.172263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:34.172738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:34.173476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:34.174323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:34.175073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:34.175619 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:34.926576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4b6a3f30-ec5a-4203-a0b0-41cee8cb25da req-064ff535-11df-44a1-a2ff-b29e621b738c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64154415-88f0-466b-bef8-1382fdd67d44", "name": "network-vif-plugged", "status": "completed", "tag": "fc603914-32ae-4452-8f3a-d9500d71d5e5"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:34.948511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4b6a3f30-ec5a-4203-a0b0-41cee8cb25da req-064ff535-11df-44a1-a2ff-b29e621b738c service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:34.949959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4b6a3f30-ec5a-4203-a0b0-41cee8cb25da req-064ff535-11df-44a1-a2ff-b29e621b738c service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:34.950619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4b6a3f30-ec5a-4203-a0b0-41cee8cb25da req-064ff535-11df-44a1-a2ff-b29e621b738c service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:34.959518 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:34.970364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-acd0922e-a662-4da4-b859-82bde7475a4b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.813088 Oct 20 14:41:34.992303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 43/87] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:34 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:35.002993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4b6a3f30-ec5a-4203-a0b0-41cee8cb25da req-064ff535-11df-44a1-a2ff-b29e621b738c service nova] Creating event network-vif-plugged:fc603914-32ae-4452-8f3a-d9500d71d5e5 for instance 64154415-88f0-466b-bef8-1382fdd67d44 on hv-cinder-77923 Oct 20 14:41:35.005981 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:35.007850 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:35.019343 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:35.020849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:35.023064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4b6a3f30-ec5a-4203-a0b0-41cee8cb25da req-064ff535-11df-44a1-a2ff-b29e621b738c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.222673 Oct 20 14:41:35.023737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:35.025329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:35.026182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 45/88] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:41:35.028094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:35.030114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:35.038397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:35.040395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:35.069946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:35.070749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:35.071936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:35.075401 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:35.076026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:35.076641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:35.369700 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:35.372992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:35.380862 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:35.381566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-38f488de-c464-4a48-9e63-1def795840d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.352531 Oct 20 14:41:35.382729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 46/89] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:35 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:35.382841 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:35.383911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-89a84283-b8ff-4fa9-b4d4-9358fe04c879 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.390217 Oct 20 14:41:35.384839 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 44/90] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:34 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:35.387837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:35.388460 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:35.391280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:35.395025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:35.395537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:35.396235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:35.397279 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:35.398090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:35.398339 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:35.540202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:35.553035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b53707b8-a1d4-449c-8e26-f60a18a933d5 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.168841 Oct 20 14:41:35.553660 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 47/91] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:35 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:35.999957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:36.000943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:36.007429 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.009161 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.012540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.013438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.014098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.014721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.222370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:36.237351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ce558b22-274d-4ac5-9dfa-8e8a559f577f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.240774 Oct 20 14:41:36.250078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 45/92] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:35 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:36.411351 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:36.413096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:36.413373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:36.413984 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:36.420687 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.420987 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.421767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.422701 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.423370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.423656 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.424227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.424331 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.425079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.426534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.427239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.428821 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.652597 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:36.656879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:36.665224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-217fdfa1-b9cc-4d25-ae3f-6d2f725faed4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.261468 Oct 20 14:41:36.665821 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 48/93] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:36 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:36.670533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:36.671373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:36.677406 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.678103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.678865 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.679757 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:36.680398 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:36.680989 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:36.686276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:36.687743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:36.688920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b070aa1b-513f-466b-a874-335cdbb369c5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.279513 Oct 20 14:41:36.701230 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 46/94] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:36 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:41:36.821832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:36.831917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-71e37826-7bde-4008-89d7-45cc851836eb tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.164895 Oct 20 14:41:36.832553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 49/95] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:36 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:37.264027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:37.265293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:37.272016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:37.272528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:37.272960 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:37.273787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:37.274322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:37.274794 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:37.423439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:37.434177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f239c82a-6d08-4feb-884b-df16b42f80f0 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.175426 Oct 20 14:41:37.435422 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 47/96] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:37 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:37.691189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:37.692740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:37.701761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:37.702506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:37.702958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:37.703850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:37.704303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:37.704990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:37.729141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:37.729809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:37.755720 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:37.756209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:37.756768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:37.757491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:37.757957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:37.758552 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:38.034125 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:38.047073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:38.048728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:38.050205 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-caeed202-eb49-4f2a-9229-661bcb16af99 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.339111 Oct 20 14:41:38.051176 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 48/97] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:37 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:41:38.068285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:38.068285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5334cb64-6324-4eb7-b723-09ca4436e7f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.378209 Oct 20 14:41:38.068285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 50/98] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:37 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:38.071608 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:38.073014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:38.079934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:38.080431 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:38.081033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:38.081745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:38.082366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:38.082935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:38.311563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:38.320113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d189dc49-1d0d-430f-a3bf-d29c3f0c837f tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.252196 Oct 20 14:41:38.336456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 51/99] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:38 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:38.457572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:38.458180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:38.466007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:38.466569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:38.467065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:38.467995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:38.468598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:38.469188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:38.627569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:38.640865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ae20292e-41b0-488d-8d19-989653c769a8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.186775 Oct 20 14:41:38.641682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 49/100] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:38 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:39.075608 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:39.076382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:39.085466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.086435 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.087063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.088581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.089275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.089926 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.092827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:39.093625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:39.100389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.101562 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.110620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.116082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.116740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.117257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.127480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:39.374093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:39.377758 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:39.383289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:39.385251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:39.386588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-859eb038-74fb-4dc7-b76c-bb2a118097a4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.315091 Oct 20 14:41:39.387144 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 52/101] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:39 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:39.392062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:39.392985 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:39.399305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.400032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.400782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.401959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.402710 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.403390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.418628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:39.427455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0ddfeee3-416a-48c2-b377-ece3ca8f0425 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.341388 Oct 20 14:41:39.444376 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 50/102] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:39 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:39.625177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:39.636271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-17b186ab-bc5d-45e7-9acc-9e09ef6a4678 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.247854 Oct 20 14:41:39.636906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 53/103] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:39 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:39.665623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:39.666903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:39.676431 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.677047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.678037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.678929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:39.679495 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:39.680014 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:39.872885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:39.882196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6bab4e7d-028a-49f8-a514-3e69c958efe8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.221801 Oct 20 14:41:39.883160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 51/104] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:39 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:40.413322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:40.413934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:40.421846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.424195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.426108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.427083 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.428523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.430272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.452633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:40.453606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:40.466886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.467786 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.468616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.469595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.470259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.472411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.739004 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:40.750095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:40.752126 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:40.753790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6f62eff1-5f19-4eb0-b562-df1de2edd8f0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.344150 Oct 20 14:41:40.769957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 54/105] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:40 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:41:40.780695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:40.785391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:40.788929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:40.796179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2f61818d-5128-4feb-9a69-03d47954dfd8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.347546 Oct 20 14:41:40.814096 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 52/106] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:40 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:40.814174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.817232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.817869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.818670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.819063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.819520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.907517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:40.908134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:40.917908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.918395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.918945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:40.919645 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:40.920093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:40.920542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:41.007798 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:41.016426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-168531af-08a1-4d65-b52a-5275699d7232 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1314 microversion: 2.1 time: 0.245116 Oct 20 14:41:41.017021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 55/107] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:40 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:41.083107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:41.092436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ab6d0c2c-b9ce-4330-a6e4-b1715ed93bef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.188675 Oct 20 14:41:41.093357 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 53/108] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:40 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:41.788869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:41.792109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:41.798608 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:41.799348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:41.799788 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:41.800574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:41.801851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:41.802396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:41.829535 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:41.831895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:41.843048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:41.843752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:41.844205 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:41.845010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:41.845618 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:41.846217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:42.053740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:42.067449 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:42.068976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:42.070542 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9b18df42-3664-4c91-b9ee-ea0b14b8c275 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.285940 Oct 20 14:41:42.071571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 56/109] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:41 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:42.077080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:42.078211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:42.084751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:42.085595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:42.086253 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:42.087166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:42.088115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:42.088768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:42.102121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:42.111158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-43e3a312-05eb-46ef-82e9-a715aeadce53 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.293586 Oct 20 14:41:42.111741 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 54/110] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:41 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:42.132598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:42.133642 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:42.140826 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:42.142139 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:42.142949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:42.143900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:42.144595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:42.147538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:42.310704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:42.323289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a68e4cd3-ef3e-4bd0-8801-4d9ac8843852 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1502 microversion: 2.1 time: 0.248489 Oct 20 14:41:42.324450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 57/111] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:42 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1502 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:42.378772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:42.387810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ba13f687-80db-4e8f-917e-84683dceb4fd tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.259190 Oct 20 14:41:42.388818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 55/112] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:42 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:43.101687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:43.112998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:43.112998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:43.112998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:43.112998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:43.113454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:43.113454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:43.113454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:43.139659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:43.140268 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:43.145576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:43.149388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:43.149880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:43.150486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:43.151652 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:43.152108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:43.152563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:43.346641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:43.353825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:43.355207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:43.356951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:43.358683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ced3e4ad-3fb2-4f2d-9a3f-800c7afe1657 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.260857 Oct 20 14:41:43.359239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 58/113] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:43 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:43.362700 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a3c18e94-8360-43fd-b798-cb3d1f518a37 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.226821 Oct 20 14:41:43.363341 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 56/114] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:43 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:43.410892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:43.411490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:43.417823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:43.418297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:43.418753 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:43.419430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:43.419874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:43.420289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:43.546751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:43.554211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f43f5907-031e-4935-b46c-6a55d7a3430f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.147050 Oct 20 14:41:43.554778 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 59/115] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:43 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:44.385363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:44.385863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:44.386634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:44.387284 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:44.391864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.392362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.392800 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.393118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.393483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.393574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.393929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.394016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.394465 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.394670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.395125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.395545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.584162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:44.588404 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:44.594006 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:44.595582 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:44.596747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a1306e40-f895-4069-9906-9f01c1eee3fc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.216138 Oct 20 14:41:44.596972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e29bdc44-5759-42cb-960e-476dbe666371 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.215193 Oct 20 14:41:44.597801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 57/116] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:44 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:44.602484 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:44.603085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:44.609534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.610440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.611040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 60/117] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:44 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:44.611318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.612200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.612806 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.613348 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.751575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:44.753207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a4524240-fdc2-4fd7-9acb-87f6bf46cf4a req-0b658eb7-6526-4551-94d4-d9f62d6825b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c72900-27b7-470e-9d95-752506e689ad", "name": "network-vif-plugged", "status": "completed", "tag": "113928f5-c90e-4f91-8207-0c0a6f2d414b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:44.759178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-54b7d9dc-b182-4226-a158-5f08561da052 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.160219 Oct 20 14:41:44.760358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 58/118] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:44 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:44.772946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a4524240-fdc2-4fd7-9acb-87f6bf46cf4a req-0b658eb7-6526-4551-94d4-d9f62d6825b0 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:44.772946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a4524240-fdc2-4fd7-9acb-87f6bf46cf4a req-0b658eb7-6526-4551-94d4-d9f62d6825b0 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:44.772946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a4524240-fdc2-4fd7-9acb-87f6bf46cf4a req-0b658eb7-6526-4551-94d4-d9f62d6825b0 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:44.778115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a4524240-fdc2-4fd7-9acb-87f6bf46cf4a req-0b658eb7-6526-4551-94d4-d9f62d6825b0 service nova] Creating event network-vif-plugged:113928f5-c90e-4f91-8207-0c0a6f2d414b for instance 38c72900-27b7-470e-9d95-752506e689ad on hv-cinder-77923 Oct 20 14:41:44.783408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a4524240-fdc2-4fd7-9acb-87f6bf46cf4a req-0b658eb7-6526-4551-94d4-d9f62d6825b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033952 Oct 20 14:41:44.784189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 61/119] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:41:45.626103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:45.626103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:45.631446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.632101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.632547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.633233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.633681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.634097 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.636081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:45.636505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:45.643198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.643689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.644318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.645050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.645508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.645932 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.830872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:45.843702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:45.845828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:45.847040 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5f973820-0532-4252-8489-023310d7672d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.226589 Oct 20 14:41:45.847668 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 59/120] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:45 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:45.858840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:45.860978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:45.867676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.868264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.869024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.869991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.870658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.871128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.888501 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:45.898098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d4902209-9710-4f9b-9175-52a51aaf50a7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.267923 Oct 20 14:41:45.898863 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 62/121] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:45 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:45.921848 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f03ce889-9ac1-496c-9386-004960dae791"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:45.931376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:45.939080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.939827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.940306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:45.941100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:45.941800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:45.942232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:46.061256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:46.075458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e708a034-4569-4be7-91d9-34f46152a1f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.226214 Oct 20 14:41:46.076249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 60/122] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:45 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:46.820222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8d0a95-894e-4244-9a27-6b86a1b5ca83", "name": "network-vif-plugged", "status": "completed", "tag": "516e6fb9-5c7c-44bb-b65b-facb0026c92b"}, {"server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "name": "network-vif-plugged", "status": "completed", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:46.831128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:46.831597 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:46.832020 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:46.845082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] Creating event network-vif-plugged:516e6fb9-5c7c-44bb-b65b-facb0026c92b for instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 on hv-cinder-77923 Oct 20 14:41:46.845579 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] Creating event network-vif-plugged:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:41:46.851981 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-b1608d9b-a1c0-46ee-ae02-0c8518d1e705 req-c71f490e-b637-47ae-b446-467957ff7e8e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.035369 Oct 20 14:41:46.852579 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 61/123] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:41:46.873471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:46.874185 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:46.879993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:46.880499 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:46.880928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:46.881592 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:46.882035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:46.882451 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:47.007357 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:47.015899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:47.017401 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:47.018480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fe2e3440-a637-4ac7-967b-85f5de5708d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.148933 Oct 20 14:41:47.019030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 62/124] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:46 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:41:47.023423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:47.024259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:47.031343 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:47.031941 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:47.032678 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:47.033445 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:47.033932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:47.034575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:47.161705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:47.169534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5b210725-9195-41e6-a039-4c920425cb5e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.149433 Oct 20 14:41:47.170091 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 63/125] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:47 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:47.174595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:47.175141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:47.180855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:47.181844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:47.182787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:47.183469 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:47.184226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:47.184676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:47.309002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:47.316554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-99107a47-641a-41af-b444-92048e214609 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.145513 Oct 20 14:41:47.317108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 64/126] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:47 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:48.045968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:48.046600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:48.052554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:48.053007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:48.053413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:48.054104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:48.054551 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:48.054973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:48.183781 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:48.191837 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:48.193315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:48.194413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b6aaeec5-047b-4f57-91cd-4f82f9cfb4b3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.153546 Oct 20 14:41:48.194970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 65/127] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:48 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:41:48.200031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:48.200664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:48.206138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:48.206621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:48.207055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:48.207738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:48.208198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:48.208652 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:48.334970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:48.343339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7e55152c-28ad-4fe1-9289-920fd0d065b4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.147393 Oct 20 14:41:48.343907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 66/128] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:48 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:48.348284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:48.348912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:48.354634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:48.355112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:48.355612 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:48.356290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:48.356763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:48.357176 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:48.372102 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:48.492674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:48.501546 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0a41135c-87c6-469a-8275-7ab0858fb018 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1361 microversion: 2.1 time: 0.156516 Oct 20 14:41:48.502337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 67/129] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:48 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:48.705494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-efbeb63d-b94c-4652-95a9-53a05efb6259 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "POST /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.791858 Oct 20 14:41:48.706498 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 63/130] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:41:45 2022] POST /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44/os-volume_attachments => generated 194 bytes in 2794 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:49.220062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:49.220903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:49.232577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.233251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.233946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.234907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.235620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.236112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.368229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:49.369096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:49.377700 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.378416 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.378845 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.379538 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.380176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.380961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.404568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:49.414368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:49.415885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:49.417276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-823f05bf-35d4-4431-9b87-7c0c8630e74e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.201097 Oct 20 14:41:49.417857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 68/131] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:49 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:49.527277 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:49.528311 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:49.537756 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:49.541475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.542534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.543059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.543781 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.544238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.544824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.547249 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2b217591-5126-4abf-ac92-4ed1e8b04412 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.184243 Oct 20 14:41:49.563102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 64/132] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:49 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:49.687477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:49.697214 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-832e16ad-0e93-41f8-990c-d1e4e6dbcdab tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1548 microversion: 2.1 time: 0.175423 Oct 20 14:41:49.708751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 69/133] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:49 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1548 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:49.723491 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:49.724036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:49.734774 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.735527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.735960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.736732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:49.737554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:49.741169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:49.834876 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4dae6885-7075-4d16-b36b-39d9c4326d58 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.116007 Oct 20 14:41:49.842817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 65/134] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:41:49 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-interface => generated 285 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:50.443295 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:50.443962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:50.454360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:50.455156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:50.455827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:50.456730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:50.457355 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:50.458013 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:50.570978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:50.572142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:50.579567 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:50.580206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:50.580755 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:50.581635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:50.582386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:50.582862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:50.869591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:50.879076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:50.880676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:50.882183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-45460643-bd54-4d77-bde6-45a7e2bb1cca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.443119 Oct 20 14:41:50.884994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 70/135] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:50 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:50.944570 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:50.954006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-475edc57-8f4c-4368-afdf-f529a7ee7219 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.386697 Oct 20 14:41:50.955016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 66/136] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:50 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:51.412427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-2f00b6d1-ae74-45e7-8af3-850080603534 req-ab982b81-b76b-4baf-9dfc-14579cec70d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c72900-27b7-470e-9d95-752506e689ad", "tag": "113928f5-c90e-4f91-8207-0c0a6f2d414b"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:51.422825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-2f00b6d1-ae74-45e7-8af3-850080603534 req-ab982b81-b76b-4baf-9dfc-14579cec70d8 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:51.423533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-2f00b6d1-ae74-45e7-8af3-850080603534 req-ab982b81-b76b-4baf-9dfc-14579cec70d8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:51.424147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-2f00b6d1-ae74-45e7-8af3-850080603534 req-ab982b81-b76b-4baf-9dfc-14579cec70d8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:51.438444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-2f00b6d1-ae74-45e7-8af3-850080603534 req-ab982b81-b76b-4baf-9dfc-14579cec70d8 service nova] Creating event network-changed:113928f5-c90e-4f91-8207-0c0a6f2d414b for instance 38c72900-27b7-470e-9d95-752506e689ad on hv-cinder-77923 Oct 20 14:41:51.445674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-2f00b6d1-ae74-45e7-8af3-850080603534 req-ab982b81-b76b-4baf-9dfc-14579cec70d8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036847 Oct 20 14:41:51.446895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 71/137] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:51.909645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:51.910974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:51.918664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:51.919508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:51.920101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:51.920974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:51.921433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:51.921869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:51.980137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:51.980929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:51.991607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:51.993049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:51.994284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:51.997829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:51.998709 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:52.000300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:52.190767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:52.203362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:52.205479 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:52.207627 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2a640754-7adc-46c2-9ce7-1cadadf031f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.302238 Oct 20 14:41:52.209644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 67/138] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:51 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:52.246778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:52.255907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-db5d8627-6a86-4584-940f-de95b62454f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.280629 Oct 20 14:41:52.260703 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 72/139] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:51 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:53.234420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:53.235011 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:53.241891 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:53.242369 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:53.242800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:53.243483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:53.243934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:53.244390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:53.279303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:53.279895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:53.286834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:53.287329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:53.287768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:53.292602 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:53.293292 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:53.293767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:53.482220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:53.506323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:53.512146 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:53.513212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a8526464-1762-4196-b180-706bf709930e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1408 microversion: 2.20 time: 0.282838 Oct 20 14:41:53.513840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 68/140] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:53 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1408 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:53.519292 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:53.538095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9de32c7c-6d65-4ace-8005-908711219ede tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1366 microversion: 2.1 time: 0.261994 Oct 20 14:41:53.538713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 73/141] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:53 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:41:54.539678 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:54.540504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:54.547999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.548519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.548954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.549651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.550099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.550515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.555320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:54.562748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:54.563532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:54.570921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.571767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.572375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.574639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.575139 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.575663 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.811167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:54.813896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:54.822381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:54.825703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:41:54.827341 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c9a1333d-e2a6-4cde-bd54-9e724fda49ce tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1600 microversion: 2.20 time: 0.292009 Oct 20 14:41:54.828237 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 69/142] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:41:54 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1600 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:41:54.841056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8c11e559-6fdb-406e-a079-bb3c8027c2e1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1555 microversion: 2.1 time: 0.269947 Oct 20 14:41:54.841056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 74/143] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:41:54 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1555 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:41:54.857752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:54.858249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:54.860822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:41:54.861314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:41:54.869097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.869264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.869743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.870499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.871089 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.871888 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.872209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.872399 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.873115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:54.873244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:54.877438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:54.877913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:55.312643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-13476905-c600-4144-bd6c-5fffef2676d1 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.455892 Oct 20 14:41:55.313706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 70/144] 10.222.0.13 () {60 vars in 1316 bytes} [Thu Oct 20 14:41:54 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-interface => generated 284 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:41:55.324678 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e99302fb-3bc1-439c-90d3-92e572598967 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.470834 Oct 20 14:41:55.325339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 75/145] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:41:54 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-interface => generated 284 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:56.426672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-e62f6fb7-4243-467b-bab5-e27aa623d248 req-76d487e6-e211-4932-a8c2-b966bcf1a116 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:56.441176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e62f6fb7-4243-467b-bab5-e27aa623d248 req-76d487e6-e211-4932-a8c2-b966bcf1a116 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:56.441913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e62f6fb7-4243-467b-bab5-e27aa623d248 req-76d487e6-e211-4932-a8c2-b966bcf1a116 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:56.442551 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e62f6fb7-4243-467b-bab5-e27aa623d248 req-76d487e6-e211-4932-a8c2-b966bcf1a116 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:56.458373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-e62f6fb7-4243-467b-bab5-e27aa623d248 req-76d487e6-e211-4932-a8c2-b966bcf1a116 service nova] Creating event network-changed:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:41:56.465373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-e62f6fb7-4243-467b-bab5-e27aa623d248 req-76d487e6-e211-4932-a8c2-b966bcf1a116 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042127 Oct 20 14:41:56.467278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 71/146] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:41:57.029230 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-d53f0a4c-4f98-4630-85f5-01d89ef1fdac req-43327e06-68eb-480f-97b8-647c31b47391 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da8d0a95-894e-4244-9a27-6b86a1b5ca83", "tag": "516e6fb9-5c7c-44bb-b65b-facb0026c92b"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:41:57.039282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=89 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:41:57.050005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d53f0a4c-4f98-4630-85f5-01d89ef1fdac req-43327e06-68eb-480f-97b8-647c31b47391 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:41:57.051304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d53f0a4c-4f98-4630-85f5-01d89ef1fdac req-43327e06-68eb-480f-97b8-647c31b47391 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:41:57.051779 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d53f0a4c-4f98-4630-85f5-01d89ef1fdac req-43327e06-68eb-480f-97b8-647c31b47391 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:41:57.065808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-d53f0a4c-4f98-4630-85f5-01d89ef1fdac req-43327e06-68eb-480f-97b8-647c31b47391 service nova] Creating event network-changed:516e6fb9-5c7c-44bb-b65b-facb0026c92b for instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 on hv-cinder-77923 Oct 20 14:41:57.072742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-d53f0a4c-4f98-4630-85f5-01d89ef1fdac req-43327e06-68eb-480f-97b8-647c31b47391 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048517 Oct 20 14:41:57.074381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 76/147] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:41:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:05.062952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:05.062952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:05.067629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:05.068783 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:05.069333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:05.070267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:05.072051 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:05.073245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:05.114296 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:42:05.237527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-00fe15b2-467e-414d-b28a-7a3d48776044 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 204 len: 0 microversion: 2.1 time: 0.185531 Oct 20 14:42:05.240777 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 72/148] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:42:05 2022] DELETE /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:42:05.264982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:05.265892 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:05.273916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:05.274404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:05.274860 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:05.276301 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:05.276552 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:05.277143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:05.412887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:05.422055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4f2d1a32-03f9-4664-b684-b0936efba544 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1554 microversion: 2.1 time: 0.176787 Oct 20 14:42:05.422684 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 77/149] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:05 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1554 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:06.446544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:06.447304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:06.451542 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:06.457060 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:06.457551 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:06.457990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:06.458686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:06.459163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:06.459584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:06.612613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:06.626767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7e842d69-4a34-4e7b-a494-77efe6c3ba21 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1554 microversion: 2.1 time: 0.184584 Oct 20 14:42:06.640620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 73/150] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:06 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1554 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:07.652151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:07.653998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:07.661308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:07.663068 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:07.663671 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:07.664558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:07.665160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:07.665755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:07.880691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:07.889191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6b5359ac-02cc-431d-b1ba-1549158b61e2 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1554 microversion: 2.1 time: 0.241038 Oct 20 14:42:07.889780 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 78/151] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:07 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1554 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:42:08.062185 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-8bc5ecbe-4c2d-4f58-b103-390d4797e78c req-802e1a44-e253-4de1-b3ea-2e0135c3a95f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "64154415-88f0-466b-bef8-1382fdd67d44", "name": "network-vif-deleted", "tag": "fc603914-32ae-4452-8f3a-d9500d71d5e5"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:08.076955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8bc5ecbe-4c2d-4f58-b103-390d4797e78c req-802e1a44-e253-4de1-b3ea-2e0135c3a95f service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:08.077833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8bc5ecbe-4c2d-4f58-b103-390d4797e78c req-802e1a44-e253-4de1-b3ea-2e0135c3a95f service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:08.085333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-8bc5ecbe-4c2d-4f58-b103-390d4797e78c req-802e1a44-e253-4de1-b3ea-2e0135c3a95f service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:08.128014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-8bc5ecbe-4c2d-4f58-b103-390d4797e78c req-802e1a44-e253-4de1-b3ea-2e0135c3a95f service nova] Creating event network-vif-deleted:fc603914-32ae-4452-8f3a-d9500d71d5e5 for instance 64154415-88f0-466b-bef8-1382fdd67d44 on hv-cinder-77923 Oct 20 14:42:08.136331 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-8bc5ecbe-4c2d-4f58-b103-390d4797e78c req-802e1a44-e253-4de1-b3ea-2e0135c3a95f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081408 Oct 20 14:42:08.138621 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 74/152] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:08.912848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:08.914209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:08.922046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:08.922614 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:08.923113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:08.923873 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:08.925363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:08.926509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:08.960326 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:08.960826 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:08.961257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:08.961711 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lazy-loading 'fault' on Instance uuid 64154415-88f0-466b-bef8-1382fdd67d44 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:42:09.024910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '812daba513084a55badecfcde843a6ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '201aed13c0e342f5b30286ce3f82eb82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:09.034905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-97dc066d-b18e-4afa-818a-05bb5f97d9e4 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 200 len: 1350 microversion: 2.1 time: 0.125697 Oct 20 14:42:09.035945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 79/153] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:08 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 1350 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:10.062398 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:10.063475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:10.077780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:10.079248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:10.080058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:10.081881 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:10.085559 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:10.086018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:10.107620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] HTTP exception thrown: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Request method failure captured: Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 HTTP/1.1 Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV39QjxPeZAqwosUibQNuigG1E3rWJgMPj3TdoXhaeVdY4p_MpewWKLmUzlyTDBga6tPJHhMTxO-s5YIbObEc-N9oRtQN0HqNOCpzh0kzwGpyOUUeIE8Nt7xNcY7vFuroWiExm0yFLaZSqrhOkHE1iW6ORI6LvWp2SB4UfhA2QFQWhk Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:42:10.114084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 812daba513084a55badecfcde843a6ff Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.115354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '64154415-88f0-466b-bef8-1382fdd67d44'} Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:42:10.116106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.117667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.118891 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Returning 404 to user: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:42:10.118891 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c32c1d62-c565-497c-9765-cf86cb2b1c83 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 404 len: 111 microversion: 2.1 time: 0.059942 Oct 20 14:42:10.118891 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 75/154] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:10 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:42:10.258640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:10.263962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:10.270660 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:10.271163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:10.271755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:10.272483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:10.272930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:10.273349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:10.287057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] HTTP exception thrown: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Request method failure captured: Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44/os-volume_attachments HTTP/1.1 Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV39QjxPeZAqwosUibQNuigG1E3rWJgMPj3TdoXhaeVdY4p_MpewWKLmUzlyTDBga6tPJHhMTxO-s5YIbObEc-N9oRtQN0HqNOCpzh0kzwGpyOUUeIE8Nt7xNcY7vFuroWiExm0yFLaZSqrhOkHE1iW6ORI6LvWp2SB4UfhA2QFQWhk Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:42:10.291613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 812daba513084a55badecfcde843a6ff Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.293052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'server_id': '64154415-88f0-466b-bef8-1382fdd67d44'} Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:42:10.293897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:10.295169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:10.298090 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Returning 404 to user: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:42:10.298090 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6724b6fd-5927-4302-8e98-788a7e731cfd tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040184 Oct 20 14:42:10.298090 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 80/155] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:42:10 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44/os-volume_attachments => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:42:11.528210 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:11.528880 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:11.535419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:11.535898 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:11.536541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:11.537243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:11.537697 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:11.538211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:11.552595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] HTTP exception thrown: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Request method failure captured: Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 HTTP/1.1 Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV39QjxPeZAqwosUibQNuigG1E3rWJgMPj3TdoXhaeVdY4p_MpewWKLmUzlyTDBga6tPJHhMTxO-s5YIbObEc-N9oRtQN0HqNOCpzh0kzwGpyOUUeIE8Nt7xNcY7vFuroWiExm0yFLaZSqrhOkHE1iW6ORI6LvWp2SB4UfhA2QFQWhk Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:42:11.554252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 812daba513084a55badecfcde843a6ff Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.555445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '64154415-88f0-466b-bef8-1382fdd67d44'} Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:42:11.556127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.557222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.558303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Returning 404 to user: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:42:11.558303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-919c6b8f-12f3-4167-8886-5d5777e7b594 tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "DELETE /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 404 len: 111 microversion: 2.1 time: 0.031867 Oct 20 14:42:11.558303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 76/156] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:42:11 2022] DELETE /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:42:11.564461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:11.565302 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] [instance: 64154415-88f0-466b-bef8-1382fdd67d44] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:11.571220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:11.571705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:11.572140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:11.572870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:11.573323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:11.573746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:11.588818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] HTTP exception thrown: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Request method failure captured: Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 HTTP/1.1 Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV39QjxPeZAqwosUibQNuigG1E3rWJgMPj3TdoXhaeVdY4p_MpewWKLmUzlyTDBga6tPJHhMTxO-s5YIbObEc-N9oRtQN0HqNOCpzh0kzwGpyOUUeIE8Nt7xNcY7vFuroWiExm0yFLaZSqrhOkHE1iW6ORI6LvWp2SB4UfhA2QFQWhk Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:42:11.591267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/201aed13c0e342f5b30286ce3f82eb82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 201aed13c0e342f5b30286ce3f82eb82 Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-DeleteServersTestJSON-448272903 Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 812daba513084a55badecfcde843a6ff Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-DeleteServersTestJSON-448272903-project Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.592554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '64154415-88f0-466b-bef8-1382fdd67d44'} Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:42:11.593218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. Oct 20 14:42:11.594222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:42:11.595181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] Returning 404 to user: Instance 64154415-88f0-466b-bef8-1382fdd67d44 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:42:11.595181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c91cf986-db05-468d-ae4a-3d7e42302dde tempest-DeleteServersTestJSON-448272903 tempest-DeleteServersTestJSON-448272903-project] 10.222.0.13 "GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44" status: 404 len: 111 microversion: 2.1 time: 0.032336 Oct 20 14:42:11.595181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 81/157] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:11 2022] GET /compute/v2.1/servers/64154415-88f0-466b-bef8-1382fdd67d44 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:42:27.616335 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=7 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:27.617160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:27.788045 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-857285382", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:27.867380 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] validate_networks() for [('c28ca665-bebd-48d6-918c-3a77995d0c6e', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:42:28.700994 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:42:28.701534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:42:28.704206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:42:28.707221 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:42:28.708030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:42:28.756295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:28.772614 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:28.773235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:28.780358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:28.780991 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:28.783113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:28.838334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:42:28.864899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for user ae94a3ece5f644c6893589a1df84d1c6 and project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:42:28.906313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:42:28.914354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:42:29.104162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-100379b0-7b57-437e-a5c5-62898aafb2cf tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.492773 Oct 20 14:42:29.121392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 77/158] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:42:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 1510 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:42:29.132171 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-01a672a7-6e6a-40ea-8a2a-75d13c0467a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:29.134263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-01a672a7-6e6a-40ea-8a2a-75d13c0467a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:29.145545 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=13 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:29.146307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=71 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:29.296673 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-01a672a7-6e6a-40ea-8a2a-75d13c0467a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:29.305923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-01a672a7-6e6a-40ea-8a2a-75d13c0467a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1221 microversion: 2.1 time: 0.177705 Oct 20 14:42:29.311321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 82/159] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:29 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1221 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:29.540187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1005826297", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:29.624739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] validate_networks() for [('c28ca665-bebd-48d6-918c-3a77995d0c6e', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:42:30.884162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:42:30.885257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:42:30.886405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:42:30.887002 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:42:30.887566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:42:30.906556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:30.907324 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:30.908117 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:30.909294 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:30.909911 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:30.910522 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:30.944768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:42:30.948884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for user ae94a3ece5f644c6893589a1df84d1c6 and project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:42:30.977852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:42:30.981010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:42:31.082504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-73532bf7-fc69-4a5d-942a-66af8a4ede15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.551590 Oct 20 14:42:31.088667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 78/160] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:42:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:42:31.100234 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6a1d1e70-09a6-405f-b152-00adf835450f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:31.101691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6a1d1e70-09a6-405f-b152-00adf835450f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:31.212020 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6a1d1e70-09a6-405f-b152-00adf835450f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:31.241554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6a1d1e70-09a6-405f-b152-00adf835450f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1222 microversion: 2.1 time: 0.141246 Oct 20 14:42:31.244702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 83/161] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:31 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1222 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:32.273230 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:32.273851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:32.285914 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:32.286650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:32.287721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:32.288630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:32.289954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:32.292610 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:32.459974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:32.487477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ac74c723-7ce7-46a0-99f0-0c6872fe70dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1226 microversion: 2.1 time: 0.218803 Oct 20 14:42:32.489879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 84/162] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:32 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1226 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:32.561504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0a29a27d-230b-446e-bcb6-6a81f1b0cef8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Action: 'create', calling method: .version_select at 0x7f6344f6c4c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1163109215", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLr1nyD7VP1Z6NiiFxOQhAEyDH6dbjDmTn5EYX5Y+MafszrB7p0hIuQsrLdMwtiai3+aweDBa7d29OIm823yzddJnjv6o8D/JGVIrFJquPA/qhBE9W82BmgtpET9YYKGFw=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:32.599928 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-0a29a27d-230b-446e-bcb6-6a81f1b0cef8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for project d5614088125349f1975cc55b25dd9dbc. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:42:32.625236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-0a29a27d-230b-446e-bcb6-6a81f1b0cef8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for user ac5921418d40446c80892b04a3eee12d and project d5614088125349f1975cc55b25dd9dbc. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:42:32.661119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0a29a27d-230b-446e-bcb6-6a81f1b0cef8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.525291 Oct 20 14:42:32.662467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 79/163] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:42:32 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:33.514447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:33.516426 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:33.532627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:33.534861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:33.535479 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:33.550923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:33.553491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:33.554482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:33.769431 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:33.781392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-97ecad72-a319-44d7-88dc-dc72bc848495 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1274 microversion: 2.1 time: 0.271657 Oct 20 14:42:33.783325 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 85/164] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:33 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1274 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:34.216850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-21a72a3e-97fb-43f2-af5d-9ce8bec25180 req-1f4a3a5d-3578-47a5-9593-275890002ce7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a463ded-2b4a-41e5-a54f-bd28d4e92777", "tag": "accb484b-67f7-4025-9af7-0d63eeee9bd3"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:34.252947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-21a72a3e-97fb-43f2-af5d-9ce8bec25180 req-1f4a3a5d-3578-47a5-9593-275890002ce7 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:34.254243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-21a72a3e-97fb-43f2-af5d-9ce8bec25180 req-1f4a3a5d-3578-47a5-9593-275890002ce7 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:34.255274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-21a72a3e-97fb-43f2-af5d-9ce8bec25180 req-1f4a3a5d-3578-47a5-9593-275890002ce7 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:34.281671 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-21a72a3e-97fb-43f2-af5d-9ce8bec25180 req-1f4a3a5d-3578-47a5-9593-275890002ce7 service nova] Creating event network-changed:accb484b-67f7-4025-9af7-0d63eeee9bd3 for instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 on hv-cinder-77923 Oct 20 14:42:34.299853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-21a72a3e-97fb-43f2-af5d-9ce8bec25180 req-1f4a3a5d-3578-47a5-9593-275890002ce7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089805 Oct 20 14:42:34.302893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 80/165] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:42:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:34.805828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:34.806442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:34.825398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:34.825898 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:34.826347 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:34.827052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:34.827510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:34.827937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:35.197140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:35.207185 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-24f7b60b-1d3b-4cd5-a0e6-72ed9d636ef9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.404798 Oct 20 14:42:35.207711 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 86/166] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:34 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:36.235255 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:36.235966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:36.244833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:36.245974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:36.246825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:36.247802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:36.248531 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:36.249298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:36.449337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:36.458092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5cfd5ff1-329f-4c3c-b2c8-39a99961fb03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.227746 Oct 20 14:42:36.474428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 81/167] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:36 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:36.681556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-8673b6d0-28c8-4521-9a65-53c7cf5fb076 req-e288a26d-9f34-4922-97a5-004478dd0197 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b5bcc045-0b0b-4f4a-991d-d40547da9027", "tag": "6f0acfab-47c9-46e0-a4ca-c0ae37a57386"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:36.694305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-8673b6d0-28c8-4521-9a65-53c7cf5fb076 req-e288a26d-9f34-4922-97a5-004478dd0197 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:36.695101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-8673b6d0-28c8-4521-9a65-53c7cf5fb076 req-e288a26d-9f34-4922-97a5-004478dd0197 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:36.695713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-8673b6d0-28c8-4521-9a65-53c7cf5fb076 req-e288a26d-9f34-4922-97a5-004478dd0197 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:36.721696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-8673b6d0-28c8-4521-9a65-53c7cf5fb076 req-e288a26d-9f34-4922-97a5-004478dd0197 service nova] Creating event network-changed:6f0acfab-47c9-46e0-a4ca-c0ae37a57386 for instance b5bcc045-0b0b-4f4a-991d-d40547da9027 on hv-cinder-77923 Oct 20 14:42:36.727362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-8673b6d0-28c8-4521-9a65-53c7cf5fb076 req-e288a26d-9f34-4922-97a5-004478dd0197 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052712 Oct 20 14:42:36.728498 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 87/168] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:42:37.482955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:37.483487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:37.490293 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:37.490859 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:37.491291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:37.492025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:37.492500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:37.492917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:37.626010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:37.633600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e587230a-b7fe-4a2c-9899-24e543b563ae tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.154559 Oct 20 14:42:37.634161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 82/169] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:37 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:38.675690 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:38.678515 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:38.697240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:38.698650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:38.728858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:38.733570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:38.734055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:38.736009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:38.861057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:38.862225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:38.869109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:38.870426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:38.871105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:38.872014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:38.872734 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:38.873365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:38.905802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6d4c5ada-2233-4f0c-95a2-ab64dd539f29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/ips" status: 200 len: 147 microversion: 2.1 time: 0.049623 Oct 20 14:42:38.906736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 83/170] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:42:38 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/ips => generated 147 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:42:39.037843 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:39.049113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-75cd08b3-9f92-4633-9afc-b6e0fa7728b3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.394790 Oct 20 14:42:39.057840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 88/171] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:38 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:40.073542 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:40.074184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:40.080953 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:40.081430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:40.082352 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:40.083217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:40.083667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:40.084083 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:40.219561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:40.227551 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f1299013-d379-4473-b3c5-09dd6f4a6dde tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.157963 Oct 20 14:42:40.228112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 84/172] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:40 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:41.252300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:41.253163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:41.255289 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=4 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:41.261464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:41.262254 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:41.262961 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:41.263757 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:41.264287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:41.264811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:41.407406 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:41.416011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0bafcc55-17ce-46c9-9464-d00fb7e1ece5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.167611 Oct 20 14:42:41.416539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 89/173] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:41 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:42.441090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:42.441704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:42.443668 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:42.450230 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:42.450950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:42.451614 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:42.452419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:42.453066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:42.453738 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:42.593400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:42.601033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-40af8f5d-4fc4-49f4-9f00-7ca142fdb690 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.163743 Oct 20 14:42:42.601605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 85/174] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:42 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:42.664800 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c5686bfe-266c-42af-b477-94cfd1be8473"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:42.667144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:42.673029 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:42.673510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:42.673943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:42.674630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:42.675082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:42.675506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:42.964933 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a94b4125-f632-40b6-b157-3f9f63cd757d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.303242 Oct 20 14:42:42.966089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 90/175] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:42:42 2022] POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:43.013174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=16 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:43.017500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-05e0f7c7-9af9-4c0c-a43a-57cea18be875 req-2dbc30fc-206c-43f5-b90e-ee9592df7997 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a463ded-2b4a-41e5-a54f-bd28d4e92777", "name": "network-vif-plugged", "status": "completed", "tag": "accb484b-67f7-4025-9af7-0d63eeee9bd3"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:43.032920 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-05e0f7c7-9af9-4c0c-a43a-57cea18be875 req-2dbc30fc-206c-43f5-b90e-ee9592df7997 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:43.033505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-05e0f7c7-9af9-4c0c-a43a-57cea18be875 req-2dbc30fc-206c-43f5-b90e-ee9592df7997 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:43.034192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-05e0f7c7-9af9-4c0c-a43a-57cea18be875 req-2dbc30fc-206c-43f5-b90e-ee9592df7997 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:43.047376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-05e0f7c7-9af9-4c0c-a43a-57cea18be875 req-2dbc30fc-206c-43f5-b90e-ee9592df7997 service nova] Creating event network-vif-plugged:accb484b-67f7-4025-9af7-0d63eeee9bd3 for instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 on hv-cinder-77923 Oct 20 14:42:43.054682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-05e0f7c7-9af9-4c0c-a43a-57cea18be875 req-2dbc30fc-206c-43f5-b90e-ee9592df7997 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041897 Oct 20 14:42:43.055510 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 86/176] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:42:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:43.287914 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:43.288533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:43.295277 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:43.295758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:43.296190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:43.296899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:43.297351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:43.297771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:43.325167 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6b0268de-c92a-4a00-8d65-1c7bac5c85bd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/ips" status: 200 len: 152 microversion: 2.20 time: 0.041954 Oct 20 14:42:43.325749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 91/177] 10.222.0.13 () {60 vars in 1289 bytes} [Thu Oct 20 14:42:43 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:42:43.626380 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:43.627200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:43.638935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:43.639209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:43.639651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:43.640452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:43.641564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:43.642153 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:43.775735 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:43.784013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a6abccc8-bc71-469f-b171-667ef2e4dc11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.162062 Oct 20 14:42:43.784625 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 87/178] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:43 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:44.195183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:44.195708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:44.202665 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:44.203148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:44.203587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:44.204280 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:44.204767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:44.205196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:44.227409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f98d14af-26d0-46b5-b855-9ad92da32d5a tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/ips" status: 200 len: 149 microversion: 2.1 time: 0.036104 Oct 20 14:42:44.227974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 92/179] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:42:44 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/ips => generated 149 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:44.806798 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:44.807399 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:44.813972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:44.814458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:44.814895 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:44.815584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:44.816039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:44.816501 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:44.944245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:44.951828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-478ed62b-b474-4e72-b2a1-b42c7a49be01 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.148926 Oct 20 14:42:44.952424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 88/180] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:44 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:45.974917 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:45.975518 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:45.982595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:45.983103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:45.983534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:45.984218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:45.984949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:45.985405 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:46.123367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:46.131316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2720aec8-4223-4ca9-bf64-f269d8aa1a24 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.160154 Oct 20 14:42:46.131901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 93/181] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:45 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:46.648688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f996c7-fd45-40e7-9029-8d1d7361a58c"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:46.651662 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:46.658067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:46.658580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:46.659004 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:46.659716 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:46.660163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:46.660667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:46.996336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ae457c2b-fad6-403a-9a23-6ab9b7bff50e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.351496 Oct 20 14:42:46.997138 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 89/182] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:42:46 2022] POST /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 194 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:42:47.155554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:47.156129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:47.162589 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:47.163080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:47.163509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:47.164187 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:47.164658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:47.165388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:47.310001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:47.317600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d3e0338d-9a90-4f9a-8eec-87ac5919749d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.166899 Oct 20 14:42:47.318372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 94/183] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:47 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:47.829704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:47.830333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:47.836819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:47.837304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:47.837732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:47.839224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:47.839663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:47.840133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:47.846720 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-f4b1faef-6cd8-4643-8d65-1378cb011bc8 req-849b154d-78e9-47e1-9ec5-a88c392fd778 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bcc045-0b0b-4f4a-991d-d40547da9027", "name": "network-vif-plugged", "status": "completed", "tag": "6f0acfab-47c9-46e0-a4ca-c0ae37a57386"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:47.863667 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f4b1faef-6cd8-4643-8d65-1378cb011bc8 req-849b154d-78e9-47e1-9ec5-a88c392fd778 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:47.864288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f4b1faef-6cd8-4643-8d65-1378cb011bc8 req-849b154d-78e9-47e1-9ec5-a88c392fd778 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:47.864989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f4b1faef-6cd8-4643-8d65-1378cb011bc8 req-849b154d-78e9-47e1-9ec5-a88c392fd778 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:47.866152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lazy-loading 'flavor' on Instance uuid a8a24968-9e6f-4fd7-9942-87adf39c1cc0 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:42:47.876590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-f4b1faef-6cd8-4643-8d65-1378cb011bc8 req-849b154d-78e9-47e1-9ec5-a88c392fd778 service nova] Creating event network-vif-plugged:6f0acfab-47c9-46e0-a4ca-c0ae37a57386 for instance b5bcc045-0b0b-4f4a-991d-d40547da9027 on hv-cinder-77923 Oct 20 14:42:47.881759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-f4b1faef-6cd8-4643-8d65-1378cb011bc8 req-849b154d-78e9-47e1-9ec5-a88c392fd778 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039884 Oct 20 14:42:47.882715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 95/184] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:42:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:42:48.134975 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-42db365d-0700-4373-babd-36afe4fafc21 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/action" status: 202 len: 0 microversion: 2.20 time: 0.309756 Oct 20 14:42:48.140796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 90/185] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Oct 20 14:42:47 2022] POST /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:42:48.145842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:48.146627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:48.153857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:48.154353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:48.154779 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:48.155582 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:48.156156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:48.156544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:48.288982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:48.298708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:48.300206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:48.301443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f7bed900-a72d-48af-8b65-128e79cd4501 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.159940 Oct 20 14:42:48.312822 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 96/186] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:48 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:42:48.342892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:48.343529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:48.357182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:48.357759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:48.358458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:48.360020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:48.360929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:48.361527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:48.505223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:48.513635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c63613a4-56fd-4973-9cd4-01c63ca81337 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1322 microversion: 2.1 time: 0.175583 Oct 20 14:42:48.514193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 91/187] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:48 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:49.329439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:49.330028 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:49.336172 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.336673 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.341590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.342563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.343379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.343855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.489002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:49.497472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:49.498896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:49.500064 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-abc075e5-bc56-4eac-863b-d21397556d2e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.174432 Oct 20 14:42:49.500663 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 97/188] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:49 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:49.536723 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:49.537358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:49.543910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.544418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.544851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.545544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.545989 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.546410 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.683744 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:49.691317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cf7d214b-d2c4-4273-b63e-45c040aed381 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1516 microversion: 2.1 time: 0.158738 Oct 20 14:42:49.691883 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 92/189] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:49 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:49.715014 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:49.717254 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:49.723080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.723549 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.723971 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.724683 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.725130 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.725545 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.749235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lazy-loading 'flavor' on Instance uuid b5bcc045-0b0b-4f4a-991d-d40547da9027 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:42:49.866894 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-37412c4a-8adc-40c0-8b4e-122f49ea62ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027/action" status: 200 len: 32 microversion: 2.1 time: 0.156240 Oct 20 14:42:49.867489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 98/190] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:42:49 2022] POST /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027/action => generated 32 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 14:42:49.878570 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:49.879187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:49.887397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.887913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.888371 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:49.889097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:49.889600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:49.890102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:50.028653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:50.037170 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-00b0a911-5fe6-4831-a08b-170ea48ad40e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.162489 Oct 20 14:42:50.038447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 93/191] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:49 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:42:50.528367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:50.529106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:50.536173 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:50.536724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:50.537178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:50.537936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:50.538382 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:50.538845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:50.543592 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:50.683165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:50.694617 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:50.696192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:50.697433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8af97353-8ea5-4d19-bd02-e1136adb3c2b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.174176 Oct 20 14:42:50.698502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 99/192] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:50 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:51.062368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:51.062972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:51.070162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:51.070944 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:51.071440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:51.072142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:51.072726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:51.073707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:51.078037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:51.204373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:51.211999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d5e3fe65-8769-430a-b27b-7d22ae35a76b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.153509 Oct 20 14:42:51.212600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 94/193] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:51 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:51.724257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:51.724956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:51.732160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:51.732673 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:51.733105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:51.733801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:51.734246 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:51.734915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:51.864824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:51.873906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:51.875544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:51.876947 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d10fb36d-f280-48d2-8166-a9346d00fa5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.156534 Oct 20 14:42:51.877555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 100/194] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:51 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:52.235828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:52.236463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:52.243050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:52.243537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:52.243969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:52.245016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:52.245492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:52.245914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:52.413556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:52.422652 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-20201e23-7c65-4521-a601-60eb3811c0db tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.191050 Oct 20 14:42:52.423239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 95/195] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:52 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:52.903077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:52.903681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:52.909991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:52.910468 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:52.910897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:52.911610 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:52.912055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:52.912495 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:53.051861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:53.061106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:53.062881 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:53.064081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-57e8a394-9c5a-4194-9baa-d27d5fba0e07 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.165004 Oct 20 14:42:53.064769 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 101/196] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:52 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:53.445804 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:53.446397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:53.453966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:53.454535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:53.455042 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:53.455781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:53.456237 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:53.456693 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:53.583454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:53.591124 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-590efac6-29ff-418f-b5dc-6f392d349367 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.149377 Oct 20 14:42:53.591694 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 96/197] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:53 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:53.740095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9f759b01-41d6-4f18-a0ee-9258c95beefa tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:53.747116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9f759b01-41d6-4f18-a0ee-9258c95beefa tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:53.747595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9f759b01-41d6-4f18-a0ee-9258c95beefa tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:53.748026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9f759b01-41d6-4f18-a0ee-9258c95beefa tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:53.816590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9f759b01-41d6-4f18-a0ee-9258c95beefa tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Going to try to stop instance {{(pid=125811) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 20 14:42:53.860379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9f759b01-41d6-4f18-a0ee-9258c95beefa tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action" status: 202 len: 0 microversion: 2.1 time: 0.123985 Oct 20 14:42:53.860984 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 102/198] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:42:53 2022] POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:42:53.869151 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:53.870008 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:53.875857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:53.876394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:53.876832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:53.877517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:53.877964 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:53.878381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:54.004090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:54.012568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cd56d503-07fd-4b7f-b75f-0cea4a167f75 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.147261 Oct 20 14:42:54.013132 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 97/199] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:53 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:54.092056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:54.092793 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:54.098924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:54.099403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:54.099832 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:54.100557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:54.101011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:54.101432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:54.238706 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:54.248992 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:54.250439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:54.251608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9147e9a9-d28e-4553-a4aa-57a742008f34 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.165101 Oct 20 14:42:54.252177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 103/200] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:54 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:54.614843 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:54.616130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:54.623556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:54.624098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:54.624567 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:54.625311 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:54.625702 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:54.626124 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:54.780680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:54.788272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3be1fcc2-774c-4179-b910-55e7f8a752e5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.177316 Oct 20 14:42:54.788868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 98/201] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:54 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:55.036499 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:55.037160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:55.044438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:55.045018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:55.045486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:55.046185 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:55.046643 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:55.047087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:55.177438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:55.186338 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ff8deeb7-4df1-406c-9ecb-009cc447cbca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.153808 Oct 20 14:42:55.186911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 104/202] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:55 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:55.278494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:55.279035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:55.285801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:55.286435 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:55.286918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:55.287766 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:55.288216 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:55.288661 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:55.419072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:55.426956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:55.428406 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:55.429551 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1bcf030b-3401-4dc2-9404-3422d5127e83 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.155764 Oct 20 14:42:55.430105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 99/203] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:55 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:55.824772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:55.824772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:55.827313 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:55.827805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:55.828244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:55.828974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:55.829427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:55.829852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:55.982632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:55.990823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5412ae73-3e0a-48e5-ab3f-a9a62a8825ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.175812 Oct 20 14:42:55.991430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 105/204] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:55 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:56.040235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1822062713", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1163109215", "security_groups": [{"name": "tempest-secgroup-smoke-41998486"}], "block_device_mapping_v2": [{"uuid": "328acbde-11a4-495e-99cf-14b398ab5c27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c924697c-b180-4b1b-9f12-d7889a054b97"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:42:56.210485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:56.211372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:56.219144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:56.219641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:56.220082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:56.220854 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:56.221297 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:56.221724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:56.348837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] validate_networks() for [('c924697c-b180-4b1b-9f12-d7889a054b97', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:42:56.441108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:56.450959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4f63e110-2c9a-4ba4-a082-84f1c5b901d4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.244338 Oct 20 14:42:56.451547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 106/205] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:56 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:42:56.469152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:56.469759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:56.475604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:56.476078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:56.476542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:56.477225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:56.477670 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:56.478083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:56.690317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:56.698455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:56.699883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:56.701096 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d1d05d46-0a69-4d1e-9ca1-a7505786ae2c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.236137 Oct 20 14:42:56.701662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 107/206] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:56 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:56.803298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:42:56.803726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:42:56.804264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:42:56.804715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:42:56.805125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:42:56.813728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:56.814235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:56.814673 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:56.815393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:56.815846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:56.816268 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:56.832872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for project d5614088125349f1975cc55b25dd9dbc. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:42:56.836749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for user ac5921418d40446c80892b04a3eee12d and project d5614088125349f1975cc55b25dd9dbc. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:42:56.894222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:42:56.896422 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='328acbde-11a4-495e-99cf-14b398ab5c27',volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:42:56.993041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:57.014801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:57.015801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:57.022538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:57.023018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:57.023447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:57.024131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:57.024603 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:57.025026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:57.033236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ba78d70f-41b8-4b22-99c9-931865e5ff02 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.997279 Oct 20 14:42:57.033877 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 100/207] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:42:56 2022] POST /compute/v2.1/servers => generated 404 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:42:57.047004 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bbf11830-c2c2-4aa1-96ef-0d2060483bea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:57.048452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bbf11830-c2c2-4aa1-96ef-0d2060483bea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:57.130176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bbf11830-c2c2-4aa1-96ef-0d2060483bea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:57.138314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bbf11830-c2c2-4aa1-96ef-0d2060483bea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1095 microversion: 2.1 time: 0.095714 Oct 20 14:42:57.139081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 101/208] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:57 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1095 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:57.200556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:57.209078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3e564777-b4e6-4256-afa6-4d3588ad7dca tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.198489 Oct 20 14:42:57.209827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 108/209] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:57 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:42:57.474688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:57.475305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:57.481669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:57.482195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:57.482629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:57.483328 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:57.483781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:57.484480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:57.727763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:57.728788 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:57.736377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:57.736964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:57.737400 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:57.738108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:57.738557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:57.738976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:57.887898 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:57.896187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-edb40fdf-1494-4f91-b69f-ee6ee9e114f1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.425402 Oct 20 14:42:57.896803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 102/210] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:57 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:57.930373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:57.938515 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:57.939973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:57.941143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cf334f59-8092-4303-abcd-381610a6af37 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.218115 Oct 20 14:42:57.941700 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 109/211] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:57 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:42:58.162288 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:58.163049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:58.169977 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.170655 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.171093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.171789 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.172241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.172693 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.234612 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:58.235432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:58.236517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:58.241629 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.242143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.242575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.243502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.244082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.245897 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e27eeb0c-aa40-4b95-af48-165f4a258104 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1201 microversion: 2.1 time: 0.087547 Oct 20 14:42:58.246011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.246661 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 103/212] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:58 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1201 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:58.417751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:58.426533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d547fc35-3aa8-4562-98f0-dbd16641b979 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.196320 Oct 20 14:42:58.427414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 110/213] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:58 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:58.919727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:58.920409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:58.926311 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.926799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.927233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.927959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.928460 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.928883 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.972206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:58.973510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:58.986363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.987873 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.988897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:58.990236 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:58.991162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:58.992058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:59.155657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:59.164599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-26ab6009-525f-4be5-b514-0915bbdca851 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.249404 Oct 20 14:42:59.180892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 104/214] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:58 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:59.187278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:59.195553 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:59.197274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:59.199023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-75461ba5-a62a-4d79-babc-264962a9e3e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.234476 Oct 20 14:42:59.199747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 111/215] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:42:58 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:42:59.269898 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:59.270731 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:59.278299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:59.278861 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:59.279376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:59.280181 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:59.280732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:59.281230 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:59.422716 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:59.431513 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f48797b5-d1ca-4974-a65a-13e4b037ab25 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1277 microversion: 2.1 time: 0.165389 Oct 20 14:42:59.432456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 105/216] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:59 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:42:59.451907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:42:59.452556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:42:59.454498 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=65 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:42:59.459889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:59.460391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:59.460824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:59.461521 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:42:59.461968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:42:59.462380 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:42:59.678153 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:42:59.696397 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-178aa614-115b-4995-b59d-24c30234d4b0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.249196 Oct 20 14:42:59.702961 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 112/217] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:42:59 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:00.073100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-544cbd51-403a-4160-8549-492c1ba3c83b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: .version_select at 0x7f6345bfe790>, body: {"keypair": {"name": "tempest-keypair-283201691", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPg/EzjAqOOyWkBeYqtn0F5ofSzjuTZ4jjjFOlgx2P8sTNg1XncsZViIZeZHF10pCZBKhvdw3fUAFvwfxtH1f/Pu5flvxXZAQ2fhmxWb184KyxZZuaqBqczKxEKT/qinxg=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:00.089800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-544cbd51-403a-4160-8549-492c1ba3c83b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:43:00.093724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-544cbd51-403a-4160-8549-492c1ba3c83b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:43:00.117623 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-544cbd51-403a-4160-8549-492c1ba3c83b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048414 Oct 20 14:43:00.118225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 106/218] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:43:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:00.190369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:00.196925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:00.208743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.213785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.214417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.215539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.216144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.216735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.232397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:00.233906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:00.244961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.245950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.249016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.250862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.251670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.252571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.532179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:00.536730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:00.545922 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-667ed592-cff9-4e43-a769-ba932d204b8c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.359314 Oct 20 14:43:00.546120 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:00.557130 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 113/219] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:00 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:00.557301 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:00.557301 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b1e9fce4-04d1-4701-951d-55ff7e281c31 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.323287 Oct 20 14:43:00.557537 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-9a75c9d8-fdf5-469f-b3ac-fa29cf45d802 req-0ae4347f-a3bf-4d0c-b502-05ae6569ffeb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b82f520-a300-4205-9ff6-f31ec81518e0", "tag": "3aeaede2-76c6-42b7-b8b7-f33a546e2f7d"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:00.560954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 107/220] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:00 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:00.561550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-9a75c9d8-fdf5-469f-b3ac-fa29cf45d802 req-0ae4347f-a3bf-4d0c-b502-05ae6569ffeb service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.562209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-9a75c9d8-fdf5-469f-b3ac-fa29cf45d802 req-0ae4347f-a3bf-4d0c-b502-05ae6569ffeb service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.562792 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-9a75c9d8-fdf5-469f-b3ac-fa29cf45d802 req-0ae4347f-a3bf-4d0c-b502-05ae6569ffeb service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.569173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:00.569788 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:00.575406 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-9a75c9d8-fdf5-469f-b3ac-fa29cf45d802 req-0ae4347f-a3bf-4d0c-b502-05ae6569ffeb service nova] Creating event network-changed:3aeaede2-76c6-42b7-b8b7-f33a546e2f7d for instance 0b82f520-a300-4205-9ff6-f31ec81518e0 on hv-cinder-77923 Oct 20 14:43:00.576932 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.577530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.578075 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.578870 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.579391 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.579904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.581048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-9a75c9d8-fdf5-469f-b3ac-fa29cf45d802 req-0ae4347f-a3bf-4d0c-b502-05ae6569ffeb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033193 Oct 20 14:43:00.581808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 114/221] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:00.716594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:00.724989 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-04ceb28a-49ee-4e08-b163-e3cc483873cd tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.162777 Oct 20 14:43:00.725686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 108/222] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:00 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:00.726708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:00.727470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:00.733895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.734873 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.735369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.736123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:00.736671 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:00.737154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:00.756847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:00.873319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:00.881714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b242fe02-bb1d-4fd1-bb9a-ae8f2718ca8c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.159368 Oct 20 14:43:00.882291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 115/223] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:00 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:01.558864 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1891682877", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc51d155-90b9-48b7-86e9-fc4346955e9e"}], "security_groups": [{"name": "tempest-securitygroup--197146551"}], "key_name": "tempest-keypair-283201691", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:01.572381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:01.573054 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:01.580022 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:01.580678 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:01.581230 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:01.581931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:01.582388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:01.582815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:01.710827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] validate_networks() for [('bc51d155-90b9-48b7-86e9-fc4346955e9e', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:43:01.787686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:01.796828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e040bea1-26f9-4361-8f64-b3397acc168b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.228388 Oct 20 14:43:01.797401 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 116/224] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:01 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:01.801902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:01.802441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:01.810071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:01.810557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:01.811012 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:01.811707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:01.812156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:01.812603 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.030434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.038901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.040789 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.042839 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4e660a15-f575-4b5f-b076-68062efccc18 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.244358 Oct 20 14:43:02.056628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 117/225] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:01 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:02.056628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:02.056628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:02.056628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.056628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.057035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.057114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.057565 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.058008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.220423 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:43:02.220869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:43:02.221377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:43:02.222086 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:43:02.222502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:43:02.231658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.232140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.232599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.233319 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.233769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.234439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.244334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.250659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:43:02.252214 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-617ee456-767c-452a-ac6e-23e8dbc2862f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.207695 Oct 20 14:43:02.252879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 118/226] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:02 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:02.254375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:43:02.257271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:02.258017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:02.264147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.264667 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.265093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.265999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.266587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.267092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:43:02.267281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.269358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:43:02.321796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c62f3cc8-7257-44e3-a24b-3b3e32b74711 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.767395 Oct 20 14:43:02.322759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 109/227] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:43:01 2022] POST /compute/v2.1/servers => generated 401 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:43:02.334032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-13e61dee-04d4-46c5-9f81-d91b4a0ac4d7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:02.334657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-13e61dee-04d4-46c5-9f81-d91b4a0ac4d7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:02.412291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-13e61dee-04d4-46c5-9f81-d91b4a0ac4d7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.420121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-13e61dee-04d4-46c5-9f81-d91b4a0ac4d7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1241 microversion: 2.1 time: 0.090019 Oct 20 14:43:02.421136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 110/228] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:02 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1241 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:02.538232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.546674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1a0dc499-7af4-4522-b075-2fec16497914 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.292688 Oct 20 14:43:02.547276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 119/229] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:02 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:02.821483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:02.822689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:02.829252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.829736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.830170 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.830856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:02.831309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:02.831734 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:02.955878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:02.964014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1bb520eb-4b57-4ef2-bb74-a4f61440336d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.146415 Oct 20 14:43:02.964619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 111/230] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:02 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:03.070350 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:03.070965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:03.078199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.078694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.079136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.079840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.080298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.080750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.266081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:03.274611 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:03.277226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:03.278593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f38f2ad6-75c2-4eec-bec3-64cad3c20fb2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.212234 Oct 20 14:43:03.279161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:03.292368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:03.292368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.292368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.292368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.292833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.292833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.292833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.293645 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 120/231] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:03 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:03.441723 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:03.442568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:03.449119 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.449792 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.450385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.451236 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.451834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.452463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.553691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:03.563454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ff843cc8-8f0f-4d92-a34d-a0b6168c049b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1293 microversion: 2.1 time: 0.125384 Oct 20 14:43:03.563454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 121/232] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:03 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1293 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:03.583274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:03.587561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:03.588907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:03.592631 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-04ca6893-24ec-4217-b036-1c9125a6b749 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.319134 Oct 20 14:43:03.593212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 112/233] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:03 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:03.595029 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.595507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.595936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.596664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.597113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.597527 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.807585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:03.816204 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4467da71-ff34-49be-9514-701cea1bd925 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.241207 Oct 20 14:43:03.817133 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 122/234] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:03 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:03.987532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:03.988150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:03.995028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.995528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.995954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:03.996675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:03.997134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:03.997562 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.123443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:04.131881 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1910e9a2-95cf-4c6b-8687-2d8ba5a13d83 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1723 microversion: 2.1 time: 0.148499 Oct 20 14:43:04.132617 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 113/235] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:03 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:04.306315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:04.307754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:04.314382 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.314861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.315379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.316216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.316704 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.317117 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.588150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:04.589155 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:04.601056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:04.609493 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.611067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.612720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.613856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.615138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:04.616206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.616653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:04.617847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-be236407-a481-4ff9-ac1d-3d45fd6c5005 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.316122 Oct 20 14:43:04.617987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.619037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 123/236] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:04 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:04.642385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:04.643930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:04.654504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.655059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.659049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.659803 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.660281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.660742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.719052 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:04.727347 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-82fe5e82-297a-49a2-a949-ca2592245dbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1299 microversion: 2.1 time: 0.144352 Oct 20 14:43:04.732408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 114/237] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:04 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1299 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:04.823940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:04.832549 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-214f4e6f-95bd-4b05-a770-6cc9ba0ec43f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.212127 Oct 20 14:43:04.833353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 124/238] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:04 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:04.840363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:04.840984 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:04.847174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.847669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.848110 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.848833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:04.849297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:04.849824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:04.854622 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:05.003921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:05.012006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7fe7f2a4-7029-439c-91be-d7bc4fbc3c25 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.175519 Oct 20 14:43:05.012613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 115/239] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:04 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:05.155860 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:05.156675 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:05.162640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.163345 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.163784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.164510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.164973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.165400 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.297921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:05.306901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cc56dfb3-5d48-4720-9b0b-a0de0f26f317 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1700 microversion: 2.1 time: 0.154464 Oct 20 14:43:05.307755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 125/240] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:05 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1700 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:05.330037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a36b7b84-f787-49f7-a2e5-0687eeb52a47 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:05.336012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a36b7b84-f787-49f7-a2e5-0687eeb52a47 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.336531 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a36b7b84-f787-49f7-a2e5-0687eeb52a47 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.337164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a36b7b84-f787-49f7-a2e5-0687eeb52a47 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.402726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a36b7b84-f787-49f7-a2e5-0687eeb52a47 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Going to try to start instance {{(pid=125810) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 20 14:43:05.449591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a36b7b84-f787-49f7-a2e5-0687eeb52a47 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action" status: 202 len: 0 microversion: 2.1 time: 0.123170 Oct 20 14:43:05.450316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 116/241] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:43:05 2022] POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:43:05.460552 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:05.461424 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:05.468179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.468958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.469691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.470561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.471369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.471654 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.645543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:05.646297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:05.653605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.654032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.654464 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.655156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.655761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.656324 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.670034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:05.684000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bc0e302f-2d0f-4b90-9364-531363fa02c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1709 microversion: 2.1 time: 0.229180 Oct 20 14:43:05.701215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 126/242] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:05 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1709 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:05.753353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:05.753862 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:05.760735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.761525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.762031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.762846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:05.763368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:05.763856 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:05.945612 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:05.966309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:05.968900 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:05.975025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7c71c2df-d490-4e7c-a402-b0c18a5ee22d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.333260 Oct 20 14:43:05.989952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 117/243] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:05 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:06.003385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:06.004185 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:06.014001 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.015139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.015927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.016656 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.017250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.017815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.041609 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:06.051044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7ef0007d-bcf1-44bb-bf5d-208dc6f3a5cd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.302130 Oct 20 14:43:06.067017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 127/244] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:05 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:06.072387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:06.073227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:06.079425 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.079915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.080433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.081259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.081715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.082140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.581139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:06.589935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1b9f5d56-3a16-4ff7-a15a-804579951d31 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.598242 Oct 20 14:43:06.590723 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 118/245] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:05 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:06.598820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:06.602585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c28fa9a4-a0be-4c50-9d28-08b1d051bfbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.534184 Oct 20 14:43:06.603174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 128/246] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:06 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:06.607528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-fe7eb21f-80c8-445f-a290-dc7b1e41fabe req-01facd30-db6b-4c89-be2b-fdcef5cd3506 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f6dc2d-fbc2-404a-b288-0e73feaedb92", "tag": "29e1878d-e620-4cd7-84a0-19edd230b233"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:06.617005 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-fe7eb21f-80c8-445f-a290-dc7b1e41fabe req-01facd30-db6b-4c89-be2b-fdcef5cd3506 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.617478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-fe7eb21f-80c8-445f-a290-dc7b1e41fabe req-01facd30-db6b-4c89-be2b-fdcef5cd3506 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.617905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-fe7eb21f-80c8-445f-a290-dc7b1e41fabe req-01facd30-db6b-4c89-be2b-fdcef5cd3506 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.629103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-fe7eb21f-80c8-445f-a290-dc7b1e41fabe req-01facd30-db6b-4c89-be2b-fdcef5cd3506 service nova] Creating event network-changed:29e1878d-e620-4cd7-84a0-19edd230b233 for instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 on hv-cinder-77923 Oct 20 14:43:06.633871 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-fe7eb21f-80c8-445f-a290-dc7b1e41fabe req-01facd30-db6b-4c89-be2b-fdcef5cd3506 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041721 Oct 20 14:43:06.634618 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 119/247] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:06.707951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:06.708838 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:06.714991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.715475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.715903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.716858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:06.717307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:06.717937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:06.845477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:06.854121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bd43787d-66ac-4ab5-a5ec-9c241562dbd1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1709 microversion: 2.1 time: 0.149526 Oct 20 14:43:06.854680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 129/248] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:06 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1709 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:07.007035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:07.007681 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:07.014600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.015078 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.015506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.016194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.016681 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.017101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.074991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:07.075604 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:07.081773 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.082263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.082704 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.083409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.084011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.084562 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.193252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:07.202096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:07.203541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:07.204735 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dc57d8c9-767c-4d4c-bfbc-03e1407c378e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.202024 Oct 20 14:43:07.205305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 120/249] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:07 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:07.238031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:07.246493 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e92737bd-a1c1-4a08-976e-51844f1304c1 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.176403 Oct 20 14:43:07.247065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 130/250] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:07 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:07.616020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:07.616662 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:07.623361 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.623839 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.624270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.624986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.625432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.625854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.626006 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:07.626659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:07.632990 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.633465 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.633891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.634649 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.635099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.635525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.822447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:07.826323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:07.830604 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-91f57084-6e55-4b7c-827b-c687909931d7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.218337 Oct 20 14:43:07.831190 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 121/251] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:07 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:07.833942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2ea42ee6-07a5-410b-876c-47687aa4264f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.211699 Oct 20 14:43:07.834507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 131/252] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:07 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:07.876830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:07.877433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:07.883200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.883675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.884103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:07.885030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:07.885484 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:07.885904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.020616 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:08.029277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e2d2270e-8aa2-4f49-bbc7-ad3c345abf9a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1709 microversion: 2.1 time: 0.156003 Oct 20 14:43:08.029860 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 122/253] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:07 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:08.231660 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:08.232303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:08.238504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.238988 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.239427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.240150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.240646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.241076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.245218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:08.269745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:08.270352 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:08.277383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.277989 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.278419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.279287 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.279835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.280264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.422534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:08.430925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:08.433029 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:08.434225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-28390d16-f648-4988-a69a-c8ecd96b74b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.207150 Oct 20 14:43:08.434794 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 132/254] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:08 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:08.456406 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:08.464323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b0b90e75-68d4-4894-b14c-2db6bb29f92c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.198323 Oct 20 14:43:08.464947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 123/255] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:08 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:08.854419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:08.855516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:08.859394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:08.860051 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:08.863105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.867924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.867924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.867924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.867924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.868335 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.874718 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.875213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.875667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:08.876395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:08.876850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:08.877269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.138177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.149918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.151488 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2d18c5e3-a178-4013-b9a8-38e369caa71f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.301754 Oct 20 14:43:09.153636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 133/256] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:08 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:09.168526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fd277838-ec5d-4d47-b84c-b4500d1a4955 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.315928 Oct 20 14:43:09.170447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:09.171416 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:09.173220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 124/257] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:08 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:09.179037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:09.179815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:09.180325 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.181065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:09.182390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:09.182864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.356455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.371503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a3cc75f4-07bb-4878-957d-19fd4c4dd975 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1713 microversion: 2.1 time: 0.216518 Oct 20 14:43:09.372130 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 134/258] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:09 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1713 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:09.459133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:09.459809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:09.465879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:09.466359 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:09.466793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.467487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:09.467943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:09.468397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.487443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:09.488018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:09.495601 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:09.496084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:09.496539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.497370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:09.497816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:09.498232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:09.671385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.679329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.682244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.684150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:09.685496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d0006479-411c-4972-9ddf-51e0eb0741fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1746 microversion: 2.20 time: 0.230359 Oct 20 14:43:09.687218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 125/259] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:09 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1746 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:09.688557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9561ded7-407c-442e-8d42-c046fbac0578 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.205273 Oct 20 14:43:09.689205 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 135/260] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:09 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:10.176893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:10.177438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:10.183840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.184314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.184771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.185446 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.185895 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.186345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.197552 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:10.198177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:10.204567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.205256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.205698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.206442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.206903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.207337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.396023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:10.400863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:10.404830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e37bcbb6-291b-4d61-8f7a-ea9449444d56 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.231730 Oct 20 14:43:10.405408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 126/261] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:10 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:10.408722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3ae91e48-697f-459f-83b1-c39975f6063b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.215476 Oct 20 14:43:10.409489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 136/262] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:10 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:10.711257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:10.711873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:10.712287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:10.713149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:10.718600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.718935 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.719084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.719418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.719529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.719844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.720192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.720550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:10.720680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.721000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:10.721101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.721418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:10.919444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:10.923117 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:10.928508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:10.930204 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:10.932384 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-71015788-9225-41f6-826f-850ed6e1de58 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1746 microversion: 2.20 time: 0.223098 Oct 20 14:43:10.933042 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 137/263] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:10 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1746 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:10.941245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-900c8932-5c49-4c71-bf53-b93cdfa50fc4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.233874 Oct 20 14:43:10.941967 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 127/264] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:10 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:11.428695 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:11.429310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:11.434053 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:11.435957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:11.436215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.439651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.440115 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.443051 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.443162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.443541 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.443653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.443970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.444070 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.444716 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.445173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.445768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.659704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:11.664057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:11.674016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-47502fd9-0c8a-43e5-8c6c-8dfea3d27106 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.245133 Oct 20 14:43:11.674639 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 128/265] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:11 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:11.675349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b87fce83-b881-4205-8c85-c9de62131ede tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.250450 Oct 20 14:43:11.679232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-79884a38-d552-4b0a-bf36-073bab97ce02 req-a93b3132-edc7-440c-af16-958a6d3bd751 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f6dc2d-fbc2-404a-b288-0e73feaedb92", "name": "network-vif-plugged", "status": "completed", "tag": "29e1878d-e620-4cd7-84a0-19edd230b233"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:11.690056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 138/266] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:11 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:11.690610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-79884a38-d552-4b0a-bf36-073bab97ce02 req-a93b3132-edc7-440c-af16-958a6d3bd751 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.691172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-79884a38-d552-4b0a-bf36-073bab97ce02 req-a93b3132-edc7-440c-af16-958a6d3bd751 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.691815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-79884a38-d552-4b0a-bf36-073bab97ce02 req-a93b3132-edc7-440c-af16-958a6d3bd751 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.707950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-79884a38-d552-4b0a-bf36-073bab97ce02 req-a93b3132-edc7-440c-af16-958a6d3bd751 service nova] Creating event network-vif-plugged:29e1878d-e620-4cd7-84a0-19edd230b233 for instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 on hv-cinder-77923 Oct 20 14:43:11.713734 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-79884a38-d552-4b0a-bf36-073bab97ce02 req-a93b3132-edc7-440c-af16-958a6d3bd751 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037975 Oct 20 14:43:11.714348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 129/267] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:11.956976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:11.958028 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:11.963654 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:11.964366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:11.964598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.965184 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.965828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.966713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.967360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.967888 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.970537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.971013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.971436 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:11.973452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:11.973452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:11.973452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:12.173633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:12.177417 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:12.182786 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:12.184243 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:12.185447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-269a02fc-1dc7-4a09-9fc0-224807ad59d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1746 microversion: 2.20 time: 0.232637 Oct 20 14:43:12.186193 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 139/268] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:11 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1746 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:12.187834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cc0caf4d-a1bd-4723-b24d-b12641b673d9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.228602 Oct 20 14:43:12.188525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 130/269] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:11 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:12.697617 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:12.698304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:12.703198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:12.704714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:12.705240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:12.705733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:12.706169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:12.706877 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:12.707330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:12.707665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:12.707811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:12.708801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=20 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:12.715093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:12.715957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:12.715957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:12.717003 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:12.717530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:12.718096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:12.918077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:12.921868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:12.925899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d085af41-4270-4a41-be38-e07941940395 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.233030 Oct 20 14:43:12.926485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 140/270] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:12 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:12.929585 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-45f48048-aff2-41a8-9d0d-341e4ee11b72 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.232457 Oct 20 14:43:12.930153 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 131/271] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:12 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:13.210238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:13.210428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:13.210859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:13.211016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:13.217717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.218342 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.218456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.218873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.218981 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.219280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.219929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.220081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.220556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.220739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.221104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.221217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.226108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:13.435377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:13.444022 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:13.446591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:13.449069 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:13.450480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d9138e1a-9295-4fc4-92b7-cee2e14bac4c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.244303 Oct 20 14:43:13.459169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9b93b453-ba16-49da-9352-ded25da60773 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1366 microversion: 2.1 time: 0.252362 Oct 20 14:43:13.459981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 132/272] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:13 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:13.465628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 141/273] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:13 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:13.760655 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-296963ab-fcd9-413c-8ea8-1cce91cd3b04 req-58ead84b-3277-4fe8-b6a1-e2b2c7dc5095 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "name": "network-vif-plugged", "status": "completed", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:13.789304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-296963ab-fcd9-413c-8ea8-1cce91cd3b04 req-58ead84b-3277-4fe8-b6a1-e2b2c7dc5095 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.790136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-296963ab-fcd9-413c-8ea8-1cce91cd3b04 req-58ead84b-3277-4fe8-b6a1-e2b2c7dc5095 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.790849 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-296963ab-fcd9-413c-8ea8-1cce91cd3b04 req-58ead84b-3277-4fe8-b6a1-e2b2c7dc5095 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.806141 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-296963ab-fcd9-413c-8ea8-1cce91cd3b04 req-58ead84b-3277-4fe8-b6a1-e2b2c7dc5095 service nova] Creating event network-vif-plugged:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:43:13.812538 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-296963ab-fcd9-413c-8ea8-1cce91cd3b04 req-58ead84b-3277-4fe8-b6a1-e2b2c7dc5095 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058660 Oct 20 14:43:13.813390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 133/274] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:43:13.954795 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:13.957752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:13.958230 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:13.960383 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:13.964258 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=94 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:13.965935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.966428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.967133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.968115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.968814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.969411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.970739 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.971498 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.972579 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:13.977270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:13.977270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:13.977270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.237736 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:14.250196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ebc5bbbc-f0c8-4e5e-9971-4564611003ea tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.303865 Oct 20 14:43:14.252976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 142/275] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:13 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:14.286327 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:14.303218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-068b8b18-db20-4a45-96b0-b354f2012196 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.352474 Oct 20 14:43:14.304143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 134/276] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:13 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:14.491345 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:14.492160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:14.493497 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:14.494480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:14.500526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:14.500715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:14.501021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:14.501415 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:14.501516 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.502021 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.502140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:14.502591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:14.503003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:14.503680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:14.504193 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.504500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.747964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:14.751793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:14.760554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:14.762413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:14.765054 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-88dcc648-132d-4394-b850-b617b9532954 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.276925 Oct 20 14:43:14.767439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5e3a09ea-bca5-49b3-b591-3fdb3b0adbdc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1555 microversion: 2.1 time: 0.277543 Oct 20 14:43:14.780546 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 135/277] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:14 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1555 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:14.786244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 143/278] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:14 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:14.791817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:14.792473 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:14.799257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:14.799865 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:14.800435 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.801299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:14.801849 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:14.802341 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:14.897856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-baa431cf-9291-4bcb-beed-a28187818c55 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110124 Oct 20 14:43:14.898443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 136/279] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:43:14 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:15.277226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:15.277951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:15.288036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.290799 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.292442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.293379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.297341 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.298001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.333363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:15.334595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:15.342115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.343052 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.343851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.346972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.347687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.349578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.643177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:15.653262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-beb0cd0f-ebb9-47b6-bb2f-01b02e71f4c0 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.329908 Oct 20 14:43:15.657829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:15.666721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8581382f-00c4-4e5b-860d-356882071c48 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.393196 Oct 20 14:43:15.679430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 137/280] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:15 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:15.680012 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 144/281] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:15 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:15.793853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:15.795058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:15.801761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.802583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.803244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.804023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.804596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.805090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.834575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-b080fa5d-12f7-4b06-bdf4-877b365514df req-ae60484d-c585-4eda-a052-0516b7c8d6ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b82f520-a300-4205-9ff6-f31ec81518e0", "name": "network-vif-plugged", "status": "completed", "tag": "3aeaede2-76c6-42b7-b8b7-f33a546e2f7d"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:15.847486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-b080fa5d-12f7-4b06-bdf4-877b365514df req-ae60484d-c585-4eda-a052-0516b7c8d6ae service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:15.848065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-b080fa5d-12f7-4b06-bdf4-877b365514df req-ae60484d-c585-4eda-a052-0516b7c8d6ae service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:15.848777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-b080fa5d-12f7-4b06-bdf4-877b365514df req-ae60484d-c585-4eda-a052-0516b7c8d6ae service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:15.863439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-b080fa5d-12f7-4b06-bdf4-877b365514df req-ae60484d-c585-4eda-a052-0516b7c8d6ae service nova] Creating event network-vif-plugged:3aeaede2-76c6-42b7-b8b7-f33a546e2f7d for instance 0b82f520-a300-4205-9ff6-f31ec81518e0 on hv-cinder-77923 Oct 20 14:43:15.869755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-b080fa5d-12f7-4b06-bdf4-877b365514df req-ae60484d-c585-4eda-a052-0516b7c8d6ae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041351 Oct 20 14:43:15.874293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 145/282] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:16.004269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:16.014349 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:16.015951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:16.017246 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ecee8d60-6b4b-4855-b529-3736f8d986ea tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.227556 Oct 20 14:43:16.018027 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 138/283] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:15 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:16.296297 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-e468c038-f6ac-49aa-876f-8fc7a0ca8286 req-ed0ee1be-dff2-4ff9-a7fc-6f63cff3a44f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "14f6dc2d-fbc2-404a-b288-0e73feaedb92", "tag": "29e1878d-e620-4cd7-84a0-19edd230b233"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:16.309959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-e468c038-f6ac-49aa-876f-8fc7a0ca8286 req-ed0ee1be-dff2-4ff9-a7fc-6f63cff3a44f service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:16.310777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-e468c038-f6ac-49aa-876f-8fc7a0ca8286 req-ed0ee1be-dff2-4ff9-a7fc-6f63cff3a44f service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:16.311417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-e468c038-f6ac-49aa-876f-8fc7a0ca8286 req-ed0ee1be-dff2-4ff9-a7fc-6f63cff3a44f service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:16.339400 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-e468c038-f6ac-49aa-876f-8fc7a0ca8286 req-ed0ee1be-dff2-4ff9-a7fc-6f63cff3a44f service nova] Creating event network-changed:29e1878d-e620-4cd7-84a0-19edd230b233 for instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 on hv-cinder-77923 Oct 20 14:43:16.353929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-e468c038-f6ac-49aa-876f-8fc7a0ca8286 req-ed0ee1be-dff2-4ff9-a7fc-6f63cff3a44f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062074 Oct 20 14:43:16.362248 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 146/284] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:16.681760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:16.683220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:16.694725 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:16.695186 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:16.695607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:16.695721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:16.696119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:16.697966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:16.698433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:16.701975 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:16.709792 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:16.711261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:16.713789 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:16.715256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:16.718050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:16.719610 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:17.003490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:17.016799 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f078546d-b096-4b34-9f4e-4d5989403022 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.327240 Oct 20 14:43:17.018127 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 147/285] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:16 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:17.048549 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:17.052666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:17.065856 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:17.066694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:17.067712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:17.068672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:17.069142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:17.072547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:17.078494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:17.091453 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e82b15f3-50e1-4a33-a752-c234cffcd5a1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.415321 Oct 20 14:43:17.092647 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 139/286] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:16 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:17.280424 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:17.289666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:17.294623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:17.297847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9c143a4c-b9b8-4f09-8b44-a0ce065f4ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.259018 Oct 20 14:43:17.299008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 148/287] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:17 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:18.044335 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:18.044936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:18.051791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:18.052409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:18.053085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:18.054285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:18.055177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:18.056519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:18.117506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:18.118114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:18.125275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:18.125760 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:18.126190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:18.126886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:18.127394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:18.128423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:18.301146 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:18.319239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-68b3f19e-8b19-40f4-8c23-00cbfde0c8d4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.279585 Oct 20 14:43:18.336893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 140/288] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:18 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:18.341913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:18.349386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:18.350420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:18.351547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8b07b046-2eaf-487a-945a-8fcd871ead54 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1265 microversion: 2.1 time: 0.240032 Oct 20 14:43:18.362417 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:18.363168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:18.363839 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:18.364819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:18.365486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:18.366115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:18.369223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 149/289] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:18 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1265 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:18.581966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:18.609383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:18.612747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:18.615634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c589e667-ab27-4caf-be20-0735d9cd5843 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.277178 Oct 20 14:43:18.616976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 141/290] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:18 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:19.343622 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:19.345015 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:19.352773 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.353534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.354128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.355056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.355667 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.356235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.376965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:19.378648 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:19.387769 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:19.397532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.405805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.407467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.408277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.408959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.409496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.626581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:19.636724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:19.645910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ab7954fd-2d44-436f-9854-4f9808a03ad9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.305918 Oct 20 14:43:19.661146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 150/291] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:19 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:19.663573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-26c17309-994a-4f41-8924-b9d2eae36a04 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1450 microversion: 2.1 time: 0.291285 Oct 20 14:43:19.664460 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 142/292] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:19 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1450 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:19.669637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:19.670362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:19.676883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.677964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.678624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.679546 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.680098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.680686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.687547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:19.688222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:19.695434 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.696186 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.697944 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.702067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:19.702613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:19.703061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:19.929749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:19.943249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:19.943503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:19.945154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:19.962553 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ded98016-4865-42f3-acb8-e37898a644c2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.292776 Oct 20 14:43:19.963539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 151/293] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:19 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:19.964140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-db22db72-33c3-4d29-ba75-25c4b62d6710 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1450 microversion: 2.1 time: 0.279022 Oct 20 14:43:19.964799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 143/294] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:19 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1450 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:20.675749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:20.677064 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:20.698728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:20.710365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:20.711162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:20.712207 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:20.714928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:20.715672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:20.983242 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:20.992376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:20.993178 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:21.007502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:21.008139 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7e3a9601-ff58-4306-a725-feb14e64a594 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.333653 Oct 20 14:43:21.020377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:21.020377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:21.020377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:21.020377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:21.020869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:21.020964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 152/295] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:20 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:21.575344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:21.584064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:21.585644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:21.588007 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e86bf843-1695-463e-b0ad-995502ceb0bf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.602484 Oct 20 14:43:21.600847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 144/296] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:20 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:22.036223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:22.036223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:22.045055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:22.045911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:22.046982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:22.047768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:22.048404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:22.048989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:22.294059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:22.306163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3d44e745-53a7-4d34-9520-5a7b8d6fabc0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.275821 Oct 20 14:43:22.307114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 153/297] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:22 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:22.578926 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-c5c072b3-d52a-46c5-8ca2-4d7536ba56a9 req-4c3b2f4f-bc88-4fbc-a1f7-2c84a8f940f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0b82f520-a300-4205-9ff6-f31ec81518e0", "tag": "3aeaede2-76c6-42b7-b8b7-f33a546e2f7d"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:22.590176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c5c072b3-d52a-46c5-8ca2-4d7536ba56a9 req-4c3b2f4f-bc88-4fbc-a1f7-2c84a8f940f8 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:22.590922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c5c072b3-d52a-46c5-8ca2-4d7536ba56a9 req-4c3b2f4f-bc88-4fbc-a1f7-2c84a8f940f8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:22.591523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c5c072b3-d52a-46c5-8ca2-4d7536ba56a9 req-4c3b2f4f-bc88-4fbc-a1f7-2c84a8f940f8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:22.604064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-c5c072b3-d52a-46c5-8ca2-4d7536ba56a9 req-4c3b2f4f-bc88-4fbc-a1f7-2c84a8f940f8 service nova] Creating event network-changed:3aeaede2-76c6-42b7-b8b7-f33a546e2f7d for instance 0b82f520-a300-4205-9ff6-f31ec81518e0 on hv-cinder-77923 Oct 20 14:43:22.609979 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-c5c072b3-d52a-46c5-8ca2-4d7536ba56a9 req-4c3b2f4f-bc88-4fbc-a1f7-2c84a8f940f8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036337 Oct 20 14:43:22.611021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 145/298] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:22.615964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:22.616693 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:22.636788 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:22.637479 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:22.638074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:22.639328 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:22.639932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:22.640897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:22.841008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:22.863513 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:22.868324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:22.874880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5271a5ae-983d-43b0-b97d-72f518a8660a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.262981 Oct 20 14:43:22.876036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 154/299] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:22 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:23.330160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:23.331098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:23.338180 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:23.373166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:23.373629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:23.374396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:23.374868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:23.375493 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:23.528777 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:23.537803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-346a123e-ee2e-4fc5-89dc-7a1542efc83f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.211431 Oct 20 14:43:23.552446 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 146/300] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:23 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:23.901092 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:23.901705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:23.908261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:23.908776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:23.909206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:23.909893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:23.910339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:23.910755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:24.039237 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:24.048647 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:24.050072 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:24.051227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-11150e52-0d6f-4b72-a6f7-4acffd89e3ad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1741 microversion: 2.20 time: 0.154738 Oct 20 14:43:24.051779 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 155/301] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:23 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1741 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:24.562940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:24.563553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:24.569882 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:24.570362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:24.570823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:24.572066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:24.572692 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:24.573121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:24.703967 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:24.712024 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0a1b5752-643b-4302-bd5a-3b049bbafc79 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.152611 Oct 20 14:43:24.712310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 147/302] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:24 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:25.076022 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:25.076656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:25.082948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:25.083431 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:25.083884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:25.084615 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:25.085044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:25.085463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:25.214591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:25.222556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:25.223983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:25.225155 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a7a4b6c1-9609-4da5-b8f5-7e85b48a7fcc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1723 microversion: 2.20 time: 0.153742 Oct 20 14:43:25.225703 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 156/303] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:25 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:25.735290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:25.735896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:25.742943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:25.743534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:25.744037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:25.744776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:25.745856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:25.746274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:25.870796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:25.878355 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a3cd947b-6f7c-432e-9d9f-0268da98eef8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.147151 Oct 20 14:43:25.878921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 148/304] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:25 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:26.250467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:26.251077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:26.257512 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:26.257993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:26.258427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:26.259118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:26.259568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:26.259995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:26.390316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:26.398442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:26.399882 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:26.401093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-617cea6e-65c2-4cf9-bd23-948e6329154e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1723 microversion: 2.20 time: 0.154545 Oct 20 14:43:26.401676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 157/305] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:26 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:26.901345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:26.902634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:26.909311 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:26.909791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:26.910278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:26.911039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:26.911490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:26.911912 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:27.046747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:27.054715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5fcf8381-ed0a-43d3-92db-7c9b65237cb5 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.157247 Oct 20 14:43:27.055290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 149/306] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:26 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:27.426871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:27.427534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:27.434713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:27.435202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:27.435635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:27.436329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:27.436805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:27.437228 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:27.575332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:27.583505 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:27.584975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:27.586134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b1c4000c-2b80-49d0-923e-f27af8d7feb0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1726 microversion: 2.20 time: 0.163247 Oct 20 14:43:27.586689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 158/307] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:27 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1726 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:27.613915 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e2346b5-78ce-440d-b085-8eb6d76a8e20"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:27.617058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:27.624255 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:27.625211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:27.625842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:27.626736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:27.627389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:27.628015 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:27.649414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:27.737817 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-a4bc0e33-48ee-4ebb-8ac7-45835d371cc5 req-04c71cdd-3fa6-4746-9c82-41aebaf4877d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "name": "network-vif-unplugged", "status": "completed", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:27.749833 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-a4bc0e33-48ee-4ebb-8ac7-45835d371cc5 req-04c71cdd-3fa6-4746-9c82-41aebaf4877d service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:27.751079 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-a4bc0e33-48ee-4ebb-8ac7-45835d371cc5 req-04c71cdd-3fa6-4746-9c82-41aebaf4877d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:27.751711 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-a4bc0e33-48ee-4ebb-8ac7-45835d371cc5 req-04c71cdd-3fa6-4746-9c82-41aebaf4877d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:27.767058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-a4bc0e33-48ee-4ebb-8ac7-45835d371cc5 req-04c71cdd-3fa6-4746-9c82-41aebaf4877d service nova] Creating event network-vif-unplugged:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:43:27.772705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-a4bc0e33-48ee-4ebb-8ac7-45835d371cc5 req-04c71cdd-3fa6-4746-9c82-41aebaf4877d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044148 Oct 20 14:43:27.773519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 159/308] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:43:27.951853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dcddf16a-6904-4c09-b325-2731ad4550d0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.341820 Oct 20 14:43:27.952572 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 150/309] 10.222.0.13 () {62 vars in 1364 bytes} [Thu Oct 20 14:43:27 2022] POST /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments => generated 188 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:43:28.078656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:28.079139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:28.079331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:28.079783 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:28.085392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:28.085781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:28.085898 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:28.086262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:28.086365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:28.086697 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:28.086970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:28.087382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:28.087486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:28.087819 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:28.087922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:28.088235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:28.131327 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125811) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 14:43:28.142053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:28.202912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-69c1cf98-1d13-4e5f-a20e-b27749394dd5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/action" status: 202 len: 0 microversion: 2.20 time: 0.128045 Oct 20 14:43:28.203511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 160/310] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Oct 20 14:43:28 2022] POST /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:43:28.211257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:28.211864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:28.218346 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:28.218845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:28.219259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:28.219946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:28.222993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:28.224949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:28.225427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:28.231545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bde4462c-797e-4985-9122-57514edd7307 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.156106 Oct 20 14:43:28.232302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 151/311] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:28 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:28.367111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:28.376727 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:28.378200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:28.379389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-79d7078f-0102-4ae9-924a-ddf6c4b57f19 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1752 microversion: 2.20 time: 0.171855 Oct 20 14:43:28.379943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 161/312] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:28 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:29.256456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:29.257067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:29.265203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:29.266373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:29.266812 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:29.267857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:29.268313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:29.268784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:29.404377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:29.406034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:29.406734 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:29.412948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ea814af4-eeae-472e-b8ce-dc81f0138cb2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.160635 Oct 20 14:43:29.413108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:29.413554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 152/313] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:29 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:29.413659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:29.414003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:29.414841 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:29.415294 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:29.415716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:29.545062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:29.553809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:29.555593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:29.556983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-92348af2-7231-4704-b6a2-69ff6d99ccd0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1754 microversion: 2.20 time: 0.155792 Oct 20 14:43:29.558569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 162/314] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:29 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1754 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:30.438182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:30.438784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:30.445104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:30.445583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:30.446014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:30.446688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:30.447132 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:30.447547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:30.577914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:30.583112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:30.583857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:30.586077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-68f42d64-c1fc-4a8c-8771-a3972a82a62e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.151627 Oct 20 14:43:30.586650 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 153/315] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:30 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:30.591481 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:30.592137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:30.592691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:30.593694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:30.594106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:30.594621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:30.730997 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:30.740309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:30.741810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:30.742992 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-373f11c6-b664-4f3b-a041-345e21649adf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.163709 Oct 20 14:43:30.743558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 163/316] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:30 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:31.610346 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:31.611158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:31.618214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:31.618631 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:31.619062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:31.621699 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:31.621815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:31.622168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:31.769454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:31.770094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:31.786793 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:31.787439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:31.787980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:31.788818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:31.789378 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:31.789893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:31.797817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:31.808799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4ee20632-6822-4e61-a488-4437c2280994 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.202173 Oct 20 14:43:31.809847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 154/317] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:31 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:31.966063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:31.977419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:31.979263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:31.980636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ad591641-0c56-4d5f-8478-dbd42bcd2bb4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.215066 Oct 20 14:43:31.981610 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 164/318] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:31 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:32.831516 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:32.832163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:32.838817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:32.839285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:32.839721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:32.840439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:32.841142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:32.841791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:33.000288 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:33.009252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9be3dad4-fd57-4af0-aba6-b711b13b0b50 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.182020 Oct 20 14:43:33.009828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 155/319] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:32 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:33.011490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:33.012105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:33.019337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:33.019879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:33.020385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:33.021079 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:33.021708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:33.022295 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:33.183520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:33.192500 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:33.193939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:33.195137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-27583700-8ac9-4bbf-b138-ee7bda95334a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.189622 Oct 20 14:43:33.195695 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 165/320] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:33 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:34.035478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:34.036092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:34.044214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:34.044905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:34.045512 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:34.046434 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:34.047235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:34.048057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:34.193667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:34.201803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0fdc68fe-912d-4048-9942-e3c89aa4f2e6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.170326 Oct 20 14:43:34.202292 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 156/321] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:34 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:34.220710 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:34.221558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:34.228111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:34.228622 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:34.229766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:34.230503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:34.230973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:34.231391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:34.250462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:34.378633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:34.389374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:34.391314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:34.392640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5236ad9a-0f92-45cf-b2cb-a93338a4378b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.175796 Oct 20 14:43:34.393353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 166/322] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:34 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:35.226330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:35.227026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:35.234921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:35.235463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:35.237316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:35.239924 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:35.241148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:35.242624 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:35.420581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:35.421285 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:35.428536 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:35.429205 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:35.429688 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:35.430399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:35.430850 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:35.431271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:35.456149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:35.465557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-74f99278-09ef-4638-8a72-49e3c15a9167 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.242752 Oct 20 14:43:35.466486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 157/323] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:35 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:35.580263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:35.590387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:35.591808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:35.593073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5fe476b0-95db-4997-b0e0-6e2c43a67079 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.177978 Oct 20 14:43:35.593663 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 167/324] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:35 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:36.489457 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:36.490109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:36.496666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:36.497156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:36.497593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:36.498313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:36.498766 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:36.499193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:36.620224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:36.621518 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:36.629568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:36.630335 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:36.630771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:36.631482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:36.631932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:36.632848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:36.641239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:36.651774 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-89e285f1-53f4-443e-8b25-0fe8ca48c7f7 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.166070 Oct 20 14:43:36.652580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 158/325] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:36 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:36.767966 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:36.777938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:36.779387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:36.780593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8ffa4648-e70a-4faa-8a7a-efb397d9f944 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.165668 Oct 20 14:43:36.781147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 168/326] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:36 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:37.675049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:37.675569 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:37.682208 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:37.682695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:37.683134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:37.683836 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:37.684290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:37.684746 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:37.805853 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:37.806449 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:37.812869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:37.813352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:37.813781 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:37.814470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:37.814920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:37.815344 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:37.825075 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:37.833365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-61039338-cf62-42fb-8829-d0aced8bc355 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.162198 Oct 20 14:43:37.833944 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 159/327] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:37 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:37.980958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:37.990566 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:37.991997 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:37.993490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8fc91e2b-788c-4a28-9c14-46beb7de3df5 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.191606 Oct 20 14:43:37.995179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 169/328] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:37 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:38.857964 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:38.858842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:38.865419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:38.865903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:38.866336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:38.867037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:38.867486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:38.867910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:39.008563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:39.018266 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b639d419-ee28-48c6-9dca-6829ebb5625e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.165261 Oct 20 14:43:39.018947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 160/329] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:38 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:39.021346 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:39.021962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:39.028525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:39.029034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:39.029487 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:39.030220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:39.030670 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:39.031120 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:39.179482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:39.190159 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:39.191866 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:39.193116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b7e9125b-181f-4d77-98b2-6e2b4439cb8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.175877 Oct 20 14:43:39.193669 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 170/330] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:39 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:40.044019 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:40.044752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:40.051600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:40.052088 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:40.052556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:40.053265 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:40.053725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:40.054150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:40.190510 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:40.200196 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2c7afbec-6e20-4888-8454-3aac22926bbd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.161164 Oct 20 14:43:40.204506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 161/331] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:40 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:40.219436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:40.220450 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:40.227233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:40.227798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:40.228414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:40.229978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:40.230509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:40.231010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:40.383449 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:40.392875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:40.395158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:40.396590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-38c09677-01ec-409d-81de-13de9ddcb246 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.181393 Oct 20 14:43:40.397156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 171/332] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:40 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:41.224650 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:41.225373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:41.232184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:41.232697 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:41.233128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:41.234073 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:41.234521 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:41.235103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:41.377203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:41.385518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aaf3dd8c-9bb0-4469-9d19-60ac119f4ef1 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.164493 Oct 20 14:43:41.386135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 162/333] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:41 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:41.422107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:41.423374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:41.429842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:41.430550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:41.431019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:41.432502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:41.433103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:41.433539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:41.566784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:41.575706 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:41.577191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:41.578390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5e68177b-54d1-418b-a7b0-53d27130f129 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.160202 Oct 20 14:43:41.579273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 172/334] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:41 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:42.409344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:42.409982 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:42.416286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:42.417124 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:42.417600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:42.418300 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:42.418746 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:42.419352 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:42.558153 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:42.565966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ac1fa328-a9d3-41ac-a66a-12e7201d2676 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.160689 Oct 20 14:43:42.566535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 163/335] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:42 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:42.603057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:42.603691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:42.611144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:42.611630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:42.612067 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:42.612797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:42.613249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:42.613676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:42.745990 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:42.754940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:42.756556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:42.757754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-192a0d47-0716-4b78-90a3-256fc93b92e4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.158693 Oct 20 14:43:42.758316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 173/336] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:42 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:43.588946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:43.589733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:43.596081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:43.596597 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:43.597027 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:43.597703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:43.598152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:43.598569 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:43.618140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:43.732841 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:43.740747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7005aaf5-8c58-4717-acd5-b1a4b7ef1fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.155712 Oct 20 14:43:43.741320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 164/337] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:43 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:43.782853 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:43.783496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:43.789987 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:43.790587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:43.791019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:43.791713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:43.792680 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:43.793153 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:43.925483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:43.934752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:43.941653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:43.941653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cc24b40a-82b3-4340-a116-270253edea03 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.159110 Oct 20 14:43:43.956209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 174/338] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:43 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:44.764227 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:44.764872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:44.767222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=61 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:44.772797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:44.773284 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:44.773782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:44.774480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:44.774935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:44.775369 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:44.901224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:44.909638 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e62859f1-d72d-4a2f-9a51-015376086773 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.149468 Oct 20 14:43:44.910205 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 165/339] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:44 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:44.963432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:44.964590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:44.971432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:44.971913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:44.972372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:44.973063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:44.973564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:44.973932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:45.106716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:45.115414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:45.116895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:45.118051 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2921378f-cb55-4c02-980f-d56422334cb9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.158448 Oct 20 14:43:45.118615 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 175/340] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:44 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:45.933957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:45.934569 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:45.940960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:45.941442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:45.941878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:45.942564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:45.943014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:45.943438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:46.070863 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:46.078645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-37967b7b-5baf-42d4-bc57-bb862a9b2063 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.149226 Oct 20 14:43:46.079211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 166/341] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:45 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:46.142902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:46.143513 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:46.149930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:46.150412 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:46.150848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:46.152128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:46.152622 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:46.153050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:46.280094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:46.288607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:46.290038 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:46.291182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2c1239ac-13a2-4a48-bc19-3bf4b7d89ef6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.152133 Oct 20 14:43:46.291743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 176/342] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:46 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:47.100809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:47.101421 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:47.107532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:47.108011 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:47.108728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:47.109412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:47.109862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:47.110284 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:47.241058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:47.249269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-13f63cc1-91d7-49df-b8c2-a1ca4f0605a0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.152194 Oct 20 14:43:47.249779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 167/343] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:47 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:47.316819 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:47.317428 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:47.324302 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:47.324820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:47.325257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:47.325948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:47.326420 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:47.326840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:47.459019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:47.467793 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:47.469259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:47.470417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bb292dcb-302c-4ce5-9c10-8a2457811c57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.157564 Oct 20 14:43:47.471012 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 177/344] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:47 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:48.273244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:48.273791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:48.280570 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:48.281057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:48.281491 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:48.282189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:48.282643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:48.283072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:48.418516 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:48.426280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0174ae8b-7434-4c45-b342-21f0e27e1255 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.156880 Oct 20 14:43:48.426856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 168/345] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:48 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:48.496590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:48.497202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:48.503509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:48.503986 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:48.504442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:48.505129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:48.505580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:48.506001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:48.637271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:48.645924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:48.647348 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:48.648561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-44143e1b-846c-466f-8d05-2f493d737316 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.155826 Oct 20 14:43:48.649112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 178/346] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:48 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:49.449503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:49.450115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:49.456520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:49.457003 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:49.457440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:49.458128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:49.458578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:49.458999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:49.592125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:49.599823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-14281838-0a6e-4d60-b200-47016576a83b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1522 microversion: 2.1 time: 0.154404 Oct 20 14:43:49.600405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 169/347] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:49 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:49.673887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:49.674432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:49.680826 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:49.681309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:49.681743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:49.682433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:49.682925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:49.683344 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:49.807136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:49.816183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:49.817651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:49.818810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c7111526-4e2e-49c4-acb1-ba60f8b16e8f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.148903 Oct 20 14:43:49.819364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 179/348] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:49 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:50.623462 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:50.623995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:50.630375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:50.630856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:50.631289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:50.631974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:50.632456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:50.632877 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:50.762826 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:50.770380 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1086fe7d-ae48-4c4e-9a71-0868c9af23f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1502 microversion: 2.1 time: 0.150995 Oct 20 14:43:50.770942 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 170/349] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:50 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1502 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:50.792511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:50.793136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:50.799806 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:50.800286 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:50.800747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:50.801435 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:50.801887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:50.802310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:50.844653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:50.845258 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:50.851036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:50.851512 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:50.851941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:50.852651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:50.853103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:50.853520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:50.982317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:50.990732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b0247885-1414-4134-9fc9-0bdc4a813d15 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1516 microversion: 2.1 time: 0.202480 Oct 20 14:43:50.991568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 180/350] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:50 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1516 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:51.012925 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:51.027997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:51.027997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:51.028658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a30903ba-1ad6-49b2-9c54-eb3b81b6b83e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.187739 Oct 20 14:43:51.029464 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 171/351] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:50 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:43:52.054454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:52.054989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:52.061860 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:52.062340 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:52.062772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:52.063494 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:52.063946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:52.064388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:52.207304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:52.216113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:52.217586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:52.218737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a580b5af-5ea3-4d9d-893f-ab781d1b75d3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.168262 Oct 20 14:43:52.219305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 181/352] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:52 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:52.386505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:52.388939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:52.395436 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:52.395999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:52.396546 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:52.397309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:52.397833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:52.398323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:52.421028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lazy-loading 'flavor' on Instance uuid 4a463ded-2b4a-41e5-a54f-bd28d4e92777 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:43:52.501879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-80fd37ce-7d49-465f-9111-e70dab807f11 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/action" status: 200 len: 32 microversion: 2.1 time: 0.119478 Oct 20 14:43:52.502941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 172/353] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:43:52 2022] POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/action => generated 32 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 14:43:52.513556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:52.514478 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:52.521872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:52.522440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:52.522973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:52.523858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:52.524315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:52.524780 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:52.658109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:52.665798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cd92c0ee-4474-48de-82b3-2ad78daa0db9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.157502 Oct 20 14:43:52.666381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 182/354] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:52 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:53.245572 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:53.246294 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:53.252272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:53.252779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:53.253209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:53.253890 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:53.254342 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:53.254760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:53.621009 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:53.647267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:53.648978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:53.651614 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cc562ad3-3ce4-467f-9e45-712488c492e7 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.410296 Oct 20 14:43:53.652510 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 173/355] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:53 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:53.689632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:53.690288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:53.696629 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:53.697112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:53.697540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:53.698332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:53.698877 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:53.699263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:53.703257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:53.896058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-cf3ad241-6923-400d-ae56-0461e8eaa641 req-992de094-2519-4b98-b8cc-997caf0a82a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "name": "network-vif-plugged", "status": "completed", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:43:53.896463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:53.906246 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9929477d-7d90-4d75-a8f2-d290d47d5e6b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.220423 Oct 20 14:43:53.907023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 183/356] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:53 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:53.910500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cf3ad241-6923-400d-ae56-0461e8eaa641 req-992de094-2519-4b98-b8cc-997caf0a82a2 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:53.911243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cf3ad241-6923-400d-ae56-0461e8eaa641 req-992de094-2519-4b98-b8cc-997caf0a82a2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:53.912245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cf3ad241-6923-400d-ae56-0461e8eaa641 req-992de094-2519-4b98-b8cc-997caf0a82a2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:53.927251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-cf3ad241-6923-400d-ae56-0461e8eaa641 req-992de094-2519-4b98-b8cc-997caf0a82a2 service nova] Creating event network-vif-plugged:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:43:53.932927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-cf3ad241-6923-400d-ae56-0461e8eaa641 req-992de094-2519-4b98-b8cc-997caf0a82a2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041126 Oct 20 14:43:53.934976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 174/357] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:43:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:43:54.677439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:54.678127 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:54.685515 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:54.686120 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:54.686557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:54.687287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:54.687737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:54.688154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:54.859009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:54.868046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:54.869510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:54.870858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d466705d-8eff-4172-8528-e8ea0a30c1d2 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.197267 Oct 20 14:43:54.871836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 184/358] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:54 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:54.933048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:54.933745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:54.940447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:54.940986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:54.941370 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:54.942079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:54.942538 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:54.942970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:55.152828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:55.161123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-15bce17f-09ae-4396-936e-c153a31d394b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.232345 Oct 20 14:43:55.161765 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 175/359] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:54 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:55.898086 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:55.899310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:55.906616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:55.907106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:55.907675 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:55.908407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:55.908869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:55.909294 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:56.051677 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:56.070556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:56.072095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:56.073867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d919ce2f-0d09-4c44-b30c-2cd97fb5f5b0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.180076 Oct 20 14:43:56.075121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 185/360] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:55 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:56.187172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:56.187836 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:56.195330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:56.195818 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:56.196252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:56.197000 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:56.197646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:56.198524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:56.394095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:56.408076 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2196612c-49c5-4b4b-8c2c-93ec07b1d1d8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.225846 Oct 20 14:43:56.409320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 176/361] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:56 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:57.102634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:57.103265 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:57.110327 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:57.110819 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:57.111251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:57.116689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:57.117547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:57.118651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:57.412161 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:57.425977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:57.432089 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:57.434361 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:57.441212 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:57.444943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0e19fa7f-f58c-4bb1-909d-3236d6155daf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1810 microversion: 2.20 time: 0.346297 Oct 20 14:43:57.446040 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 186/362] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:57 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1810 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:57.446195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:57.446929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:57.448200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:57.449203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:57.449806 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:57.450400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:57.669686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:57.685576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4e663bad-db1d-4308-a8db-ec431e46ea6a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.257103 Oct 20 14:43:57.696825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 177/363] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:57 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:43:58.474217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:58.476291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:58.484996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:43:58.488009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:58.489269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:58.489888 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:58.491342 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:58.493761 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:58.494378 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:58.710440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:58.712299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:58.720160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:58.720939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:58.721397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:58.722094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:58.722590 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:58.722947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:58.755388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:58.767053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:58.778198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:58.780321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8199d120-2a3a-42aa-9b89-fd9283c2b2d4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1797 microversion: 2.20 time: 0.309707 Oct 20 14:43:58.782101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 187/364] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:43:58 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1797 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:43:58.888066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:43:58.899003 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fe945315-3396-4ac8-b6e3-144c7d1d8bf9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.192737 Oct 20 14:43:58.899803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 178/365] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:58 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:43:59.924425 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:43:59.925047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:43:59.938053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:59.944847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:59.945490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:43:59.947405 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:43:59.949058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:43:59.949984 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:00.255647 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:00.267273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3f0188ec-f461-4cbf-ae7e-a253d24c6b35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.347483 Oct 20 14:44:00.268950 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 188/366] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:43:59 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:01.296109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:01.296771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:01.303680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:01.304383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:01.304972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:01.305837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:01.306438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:01.307049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:01.582513 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:01.586241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:01.597622 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-60f0aa65-7aad-4cc5-83c4-a78d1e31bbce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.310309 Oct 20 14:44:01.598847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 179/367] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:01 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:02.634170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:02.636859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:02.644681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:02.645516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:02.646392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:02.647303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:02.647942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:02.648607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:02.898077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:02.908842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7dedfa0a-d053-4172-83f3-f879135e0cec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.289511 Oct 20 14:44:02.910154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 189/368] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:02 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:03.937779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:03.939673 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:03.949342 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:03.950060 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:03.950494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:03.951192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:03.951803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:03.952225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:04.089729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:04.097421 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-71c9a1dc-7bfc-4ffd-820d-d25e7f9dcc93 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.164399 Oct 20 14:44:04.098191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 180/369] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:03 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:05.122611 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:05.124158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:05.131495 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:05.135499 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:05.136423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:05.137875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:05.138559 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:05.139452 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:05.297044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:05.305536 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e3e6faf9-b405-4eda-8383-d6a8afe2d92c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.187456 Oct 20 14:44:05.306142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 190/370] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:05 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:06.329884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:06.331084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:06.337983 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:06.339745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:06.340194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:06.340934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:06.341549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:06.342158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:06.524576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:06.538466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bfac2ebc-234f-4298-8246-566cab058a91 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.212536 Oct 20 14:44:06.539164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 181/371] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:06 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:07.567036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:07.567700 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:07.580527 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:07.581396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:07.581839 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:07.582564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:07.586635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:07.587282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:07.756760 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:07.769714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-38064cee-9ad2-4aa1-9f0a-cbb92c5ba244 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.206554 Oct 20 14:44:07.770523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 191/372] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:07 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:08.793291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:08.794814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:08.802096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:08.802797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:08.803752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:08.804928 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:08.805543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:08.806239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:09.013878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:09.022796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ca8c798b-8f34-4378-9316-b148565b4d60 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.233333 Oct 20 14:44:09.024119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 182/373] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:08 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:10.047900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:10.048623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:10.055652 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:10.056149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:10.057650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:10.058496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:10.058979 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:10.059403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:10.219463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:10.230670 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-30475c7d-3edc-429b-a915-72958ec07fd0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.186849 Oct 20 14:44:10.231995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 192/374] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:10 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:11.262243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:11.263619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:11.269988 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:11.270678 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:11.271312 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:11.272838 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:11.273652 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:11.274279 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:11.441679 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:11.451740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a470365e-da39-4335-8441-154746e9e2ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.193419 Oct 20 14:44:11.460557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 183/375] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:11 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:11.825017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:11.825553 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:11.832529 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:11.833377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:11.834038 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:11.834825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:11.835366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:11.835862 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:11.862024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d57db783-e777-42e0-8b9a-fcb336bad73b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/ips" status: 200 len: 148 microversion: 2.1 time: 0.041042 Oct 20 14:44:11.862884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 193/376] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:44:11 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/ips => generated 148 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:11.876745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83f996c7-fd45-40e7-9029-8d1d7361a58c"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:11.879127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:11.886949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:11.886949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:11.886949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:11.887471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:11.887765 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:11.888181 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:11.976095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Invalid volume: volume 83f996c7-fd45-40e7-9029-8d1d7361a58c is already attached to instances: da8d0a95-894e-4244-9a27-6b86a1b5ca83 Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: POST /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/os-volume_attachments HTTP/1.1 Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 74 Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:44:11.979761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {"volumeAttachment": {"volumeId": "83f996c7-fd45-40e7-9029-8d1d7361a58c"}} Oct 20 14:44:11.981283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Invalid volume: volume 83f996c7-fd45-40e7-9029-8d1d7361a58c is already attached to instances: da8d0a95-894e-4244-9a27-6b86a1b5ca83 Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'server_id': '14f6dc2d-fbc2-404a-b288-0e73feaedb92', 'body': {'volumeAttachment': {'volumeId': '83f996c7-fd45-40e7-9029-8d1d7361a58c'}}} Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 83f996c7-fd45-40e7-9029-8d1d7361a58c is already attached to instances: da8d0a95-894e-4244-9a27-6b86a1b5ca83 Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:11.982018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 83f996c7-fd45-40e7-9029-8d1d7361a58c is already attached to instances: da8d0a95-894e-4244-9a27-6b86a1b5ca83 Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:11.983781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 83f996c7-fd45-40e7-9029-8d1d7361a58c is already attached to instances: da8d0a95-894e-4244-9a27-6b86a1b5ca83 Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 400 to user: Invalid volume: volume 83f996c7-fd45-40e7-9029-8d1d7361a58c is already attached to instances: da8d0a95-894e-4244-9a27-6b86a1b5ca83 {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:44:11.984922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cd119534-e5cb-411a-a949-86aa24fac706 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108607 Oct 20 14:44:11.985858 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 184/377] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:44:11 2022] POST /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92/os-volume_attachments => generated 174 bytes in 114 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:44:11.990894 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:11.991510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:12.000387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.000975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.001491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.002344 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.002869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.003364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.029851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:44:12.126991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b9efa562-fadd-4044-85cc-263e384bbd27 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 204 len: 0 microversion: 2.1 time: 0.139560 Oct 20 14:44:12.127763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 194/378] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:44:11 2022] DELETE /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:44:12.137769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:12.138524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:12.145649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.146240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.146745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.147515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.148034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.148556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.292886 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:12.301809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3667e992-5d53-4c60-9fe7-ea3e0a4b0b02 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1679 microversion: 2.1 time: 0.169596 Oct 20 14:44:12.302672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 185/379] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:12 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:12.480444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:12.481267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:12.488176 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.488756 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.489260 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.489997 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.490460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.490921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.597075 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:12.597927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:12.605969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.606784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.607403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.608585 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:12.609234 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:12.609860 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:12.663750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:12.674062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-96f5d6e5-15c3-4eaf-af81-af7d32f23cb3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.198121 Oct 20 14:44:12.675603 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 195/380] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:12 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:12.751761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lazy-loading 'services' on Instance uuid 38c72900-27b7-470e-9d95-752506e689ad {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:12.885921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-db8872b9-d3fe-4dec-b0b0-90360aacda2b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-volume_attachments/c5686bfe-266c-42af-b477-94cfd1be8473" status: 202 len: 0 microversion: 2.1 time: 0.291949 Oct 20 14:44:12.886534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 186/381] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:44:12 2022] DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-volume_attachments/c5686bfe-266c-42af-b477-94cfd1be8473 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:13.327908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:13.329845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:13.336547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:13.337041 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:13.337477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:13.338477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:13.338998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:13.339425 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:13.479449 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:13.487596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bcb797d3-fe72-432d-90ff-7b8d0dcb52b2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1679 microversion: 2.1 time: 0.163333 Oct 20 14:44:13.504085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 196/382] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:13 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1679 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:13.586664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3f5ff11c-7f66-4da1-b3db-ea10f0665866 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Action: 'create', calling method: .version_select at 0x7f6344f170d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1236050222", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMhwgcCkMyKietDKhzO1OFFkIgywfFKGCWZWaiuVf0eaWT17oGterlzkyfIP2HIFoo87SObD3k9vxYGT1lwnwQchSHzbrU0oNOg8/8toLULY16Sok9lyTC669GrZzNfQaQ=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:13.602321 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3f5ff11c-7f66-4da1-b3db-ea10f0665866 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Getting quotas for project adc778cfb32049d5844da08c78ba014a. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:13.606373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3f5ff11c-7f66-4da1-b3db-ea10f0665866 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Getting quotas for user 95515d28733f4c7e837eee5673346901 and project adc778cfb32049d5844da08c78ba014a. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:13.627544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3f5ff11c-7f66-4da1-b3db-ea10f0665866 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.045642 Oct 20 14:44:13.628134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 187/383] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:44:13 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:13.679493 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1742908531", "imageRef": "4c224332-2836-451d-9772-c8542cf7489d", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1236050222", "networks": [{"uuid": "0c570c99-cf1a-4e1f-a4b2-fc751b9dfbf7"}]}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:13.697959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:13.698712 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:13.706715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:13.707437 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:13.708149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:13.709241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:13.709772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:13.710322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:13.742746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] validate_networks() for [('0c570c99-cf1a-4e1f-a4b2-fc751b9dfbf7', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:44:13.935887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:13.943667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-064f0ff0-01f8-40cc-8780-265d897b8bcd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.250445 Oct 20 14:44:13.944274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 188/384] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:13 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:14.183074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:44:14.183493 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:44:14.183992 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:44:14.184434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:44:14.184852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:44:14.193504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:14.193983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:14.194412 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:14.195182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:14.195626 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:14.196045 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:14.212312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Getting quotas for project adc778cfb32049d5844da08c78ba014a. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:14.216939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Getting quotas for user 95515d28733f4c7e837eee5673346901 and project adc778cfb32049d5844da08c78ba014a. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:14.227786 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:44:14.230607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4c224332-2836-451d-9772-c8542cf7489d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:44:14.277486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-222e6da7-4d58-489d-8525-9c91bda30928 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.601796 Oct 20 14:44:14.278322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 197/385] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:44:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:44:14.289085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ad54cb50-f9cb-4e85-9b29-ff433f0596ff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:14.289700 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ad54cb50-f9cb-4e85-9b29-ff433f0596ff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:14.358304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ad54cb50-f9cb-4e85-9b29-ff433f0596ff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:14.366228 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ad54cb50-f9cb-4e85-9b29-ff433f0596ff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1259 microversion: 2.1 time: 0.080726 Oct 20 14:44:14.367113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 189/386] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:14 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1259 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:14.512478 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:14.513089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:14.519985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:14.520693 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:14.521283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:14.522155 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:14.522762 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:14.523352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:14.669342 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:14.677047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5f4a7eb6-ec67-4f84-8dfd-360534878ba8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1679 microversion: 2.1 time: 0.169709 Oct 20 14:44:14.677632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 198/387] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:14 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:14.967535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:14.968145 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:14.970597 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:14.976480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:14.976967 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:14.977407 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:14.978100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:14.978552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:14.978978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.121001 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:15.129493 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0ccc28d0-6dd8-406b-817d-0cdcb2c1df58 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.165863 Oct 20 14:44:15.130176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 190/388] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:14 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:15.384977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-30597b43-c8de-4e22-a62f-b1252f8ac653 req-85b9cfd5-1da5-404f-9476-41ba4381be40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "14f6dc2d-fbc2-404a-b288-0e73feaedb92", "name": "network-vif-deleted", "tag": "29e1878d-e620-4cd7-84a0-19edd230b233"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:15.392409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:15.393816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:15.398286 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-30597b43-c8de-4e22-a62f-b1252f8ac653 req-85b9cfd5-1da5-404f-9476-41ba4381be40 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:15.398626 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-30597b43-c8de-4e22-a62f-b1252f8ac653 req-85b9cfd5-1da5-404f-9476-41ba4381be40 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:15.399447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-30597b43-c8de-4e22-a62f-b1252f8ac653 req-85b9cfd5-1da5-404f-9476-41ba4381be40 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.405122 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:15.406241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:15.407076 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:15.408064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.409216 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:15.410182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:15.411040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.415032 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-30597b43-c8de-4e22-a62f-b1252f8ac653 req-85b9cfd5-1da5-404f-9476-41ba4381be40 service nova] Creating event network-vif-deleted:29e1878d-e620-4cd7-84a0-19edd230b233 for instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 on hv-cinder-77923 Oct 20 14:44:15.421031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-30597b43-c8de-4e22-a62f-b1252f8ac653 req-85b9cfd5-1da5-404f-9476-41ba4381be40 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040341 Oct 20 14:44:15.422147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 199/389] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:15.703329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:15.704260 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:15.718244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:15.723089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:15.723789 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.724726 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:15.725328 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:15.725930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.806418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:15.806910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:15.807343 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:15.807906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'fault' on Instance uuid 14f6dc2d-fbc2-404a-b288-0e73feaedb92 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:15.820026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:15.829317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8fff2088-6d5b-4cce-9b34-48857595c4a5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1263 microversion: 2.1 time: 0.444038 Oct 20 14:44:15.830707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 191/390] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:15 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1263 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:15.855061 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:15.863697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3e6ce31d-a821-424b-8b35-1b599e4f4789 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1331 microversion: 2.1 time: 0.165802 Oct 20 14:44:15.864666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 200/391] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:15 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1331 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:16.149767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ee07944b-7696-4b2b-baf9-c51dadcc6181 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:16.153606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:16.155075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:16.160395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee07944b-7696-4b2b-baf9-c51dadcc6181 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.163016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee07944b-7696-4b2b-baf9-c51dadcc6181 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.163879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee07944b-7696-4b2b-baf9-c51dadcc6181 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.164004 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.164480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.165203 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.166271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.167583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.168192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.195219 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ee07944b-7696-4b2b-baf9-c51dadcc6181 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Going to try to stop instance {{(pid=125810) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 20 14:44:16.252935 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ee07944b-7696-4b2b-baf9-c51dadcc6181 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action" status: 202 len: 0 microversion: 2.1 time: 0.107690 Oct 20 14:44:16.254137 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 192/392] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:44:16 2022] POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:16.266834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:16.267805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:16.275305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.276001 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.277605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.278793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.279354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.279879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.343613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:16.355925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-74811561-8a7b-49bb-aa12-a550d808fccc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.206729 Oct 20 14:44:16.356527 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 201/393] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:16 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:16.454350 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:16.465397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9f09a9c3-edc2-4850-9e1e-8e043fac3651 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.202166 Oct 20 14:44:16.466356 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 193/394] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:16 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:16.855392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:16.856177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:16.863373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.863861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.864291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.865036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.865519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.866135 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.889417 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:16.890037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:16.896282 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.896804 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.897244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.897941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.898391 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.898804 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.931446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:16.932201 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:16.933232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:16.933669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:16.934125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'fault' on Instance uuid 14f6dc2d-fbc2-404a-b288-0e73feaedb92 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:16.940387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-80c1fdd9-78f7-41ba-81fc-c131c430db36 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1255 microversion: 2.1 time: 0.088962 Oct 20 14:44:16.941171 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 202/395] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:16 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1255 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:16.982255 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:16.990630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7b82703-1b79-4bcf-9437-cdf82f1e3c2f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 200 len: 1331 microversion: 2.1 time: 0.106455 Oct 20 14:44:16.991228 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 194/396] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:16 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:17.380042 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:17.380626 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:17.387442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.387938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.388404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.389113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.389567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.389986 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.488841 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:17.489449 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:17.497611 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.498373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.498805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.499509 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.499960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.500400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.522033 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:17.530797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b3728eb6-a5ac-4f84-b44b-26e6c9aba7cd tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1502 microversion: 2.1 time: 0.154572 Oct 20 14:44:17.531377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 203/397] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:17 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1502 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:17.556293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "beff2fa8-9bc3-4fc1-9ba5-0045f35d2465"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:17.558816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:17.564670 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.565144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.565569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.566251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.566711 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.567119 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.591598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] HTTP exception thrown: Cannot 'attach_volume' instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 while it is in vm_state rescued Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Request method failure captured: Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/os-volume_attachments HTTP/1.1 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 74 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV5TjoJLYhDXw1bj-3kscJgEH0wdlXR8gFBrluD-CiLj182QNmPe2U_X6kVdriE3DOCvvlh9PfylUAUezoqa8Gwnw10EGesOKq8iAZxHLj9EqZ9Io1PzTPzKIHMKpeC9DtPEU2wJxlLlfTGKNaWH_AR0ABT8P-fZ1C7uZWTH3U-jxg0 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:44:17.593509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: ae94a3ece5f644c6893589a1df84d1c6 Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {"volumeAttachment": {"volumeId": "beff2fa8-9bc3-4fc1-9ba5-0045f35d2465"}} Oct 20 14:44:17.594818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Cannot 'attach_volume' instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 while it is in vm_state rescued Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'server_id': '4a463ded-2b4a-41e5-a54f-bd28d4e92777', 'body': {'volumeAttachment': {'volumeId': 'beff2fa8-9bc3-4fc1-9ba5-0045f35d2465'}}} Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:44:17.595575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 while it is in vm_state rescued Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:17.596931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 while it is in vm_state rescued Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Returning 409 to user: Cannot 'attach_volume' instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 while it is in vm_state rescued {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ba2d8cc2-6f3e-454b-a241-fbf70a2acb0e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042719 Oct 20 14:44:17.598418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 204/398] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:44:17 2022] POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Oct 20 14:44:17.610975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:17.611640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:17.618363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.619453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.620089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.621123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.621812 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.622324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.653020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:17.661160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9adbab05-c136-4c7d-84ec-196ac38f6ea3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.176042 Oct 20 14:44:17.662051 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 195/399] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:17 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:17.712532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a648fa60-390d-401b-84eb-20e8d03f6c5e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/action" status: 202 len: 0 microversion: 2.1 time: 0.112084 Oct 20 14:44:17.713300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 205/400] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:44:17 2022] POST /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:17.722308 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:17.722914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:17.731001 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.731775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.732433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.733598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.734231 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.735012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.770888 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:17.922547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:17.930635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-49e313db-2071-4e3c-a33b-7923f5cf31ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1510 microversion: 2.1 time: 0.212212 Oct 20 14:44:17.931275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 196/401] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:17 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1510 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:17.964932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:17.965582 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:17.971790 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.972267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.972730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:17.973806 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:17.977403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:17.977403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.018440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:18.019139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:18.026112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.027524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.028275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.029182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.029786 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.030449 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.045224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 HTTP/1.1 Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:44:18.047162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:44:18.048810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '14f6dc2d-fbc2-404a-b288-0e73feaedb92'} Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:44:18.049635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:44:18.050771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:18.051803 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:18.051904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:44:18.051904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c11a72c4-c8aa-46fa-9e7a-b88596d5aae9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 404 len: 111 microversion: 2.1 time: 0.038762 Oct 20 14:44:18.051904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 197/402] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:18 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 14:44:18.059318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6c6ff707-f0d7-4324-a48f-46dbd7037913 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1311 microversion: 2.1 time: 0.099857 Oct 20 14:44:18.059892 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 206/403] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:17 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:18.061321 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9299cd71-9b83-4d89-ae16-57d7ae11d1f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '.version_select at 0x7f6344e5e9d0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:18.086568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9299cd71-9b83-4d89-ae16-57d7ae11d1f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-283201691" status: 202 len: 0 microversion: 2.1 time: 0.032219 Oct 20 14:44:18.087155 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 198/404] 10.222.0.13 () {58 vars in 1218 bytes} [Thu Oct 20 14:44:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-283201691 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:18.686023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:18.686560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:18.692524 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.693008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.693441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.694131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.694581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.694996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.942470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:18.943194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:18.943772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:18.950855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f38b1abe-5e4a-4419-a9d1-cefa13afd8ca tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.270203 Oct 20 14:44:18.951523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.952112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 207/405] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:18 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:18.952234 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.952667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.953382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.953841 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.954904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.956992 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:18.957598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:18.963873 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.964502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.964942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:18.965636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:18.966733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:18.967119 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:19.041701 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'services' on Instance uuid da8d0a95-894e-4244-9a27-6b86a1b5ca83 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:19.118644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b13a1d7c-9776-45b3-bc9d-26b236ede97d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments/83f996c7-fd45-40e7-9029-8d1d7361a58c" status: 202 len: 0 microversion: 2.1 time: 0.179848 Oct 20 14:44:19.119241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 199/406] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:44:18 2022] DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments/83f996c7-fd45-40e7-9029-8d1d7361a58c => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 14:44:19.128775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:19.129471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:19.135481 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:19.136735 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:19.137182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:19.137883 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:19.138338 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:19.138769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:19.166072 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:19.176111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c0b1fa15-96c9-4e85-9a4d-e1c248e6fb6e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1510 microversion: 2.1 time: 0.222575 Oct 20 14:44:19.176813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 208/407] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:18 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1510 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:19.181471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:19.184362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:19.192676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:19.193464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:19.193961 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:19.194733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:19.195258 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:19.195750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:19.213466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:19.222055 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fc7e4913-33fa-47bd-ae32-bf065948bb68 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1317 microversion: 2.1 time: 0.097342 Oct 20 14:44:19.223020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 200/408] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:19 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1317 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:19.227748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-29d82d1f-a04a-4ed3-827b-b6ce2fd7cfd9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049811 Oct 20 14:44:19.228403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 209/409] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:19 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:19.976548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:19.977157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:19.983819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:19.984294 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:19.984752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:19.985432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:19.985933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:19.986354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.112951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:20.120981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2b297cfc-800d-4d27-89ab-3b9293452186 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.148270 Oct 20 14:44:20.121539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 201/410] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:19 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:20.201559 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:20.202170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:20.209237 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:20.209717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:20.210356 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.211097 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:20.211489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:20.212305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.241850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:20.244193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:20.251566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:20.252054 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:20.252519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.253216 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:20.253668 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:20.254084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.289202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a8d414cc-25b7-46d7-ae55-c636422b2420 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051355 Oct 20 14:44:20.297527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 202/411] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:20 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:20.309743 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:20.310528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:20.317127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:20.317678 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:20.318379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.319006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:20.320748 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:20.321566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:20.578936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:20.586623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-48ec1531-3d6e-439f-b84a-56a624b723ed tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1510 microversion: 2.1 time: 0.389744 Oct 20 14:44:20.587195 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 210/412] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:20 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1510 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:20.640941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:20.648592 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e28c0932-6224-41a0-84bb-26c53e323c72 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.349815 Oct 20 14:44:20.649161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 203/413] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:20 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:21.077466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-200f4ab6-ee96-4b97-9497-ae969e31381e req-2ff35f54-205e-4628-8cbe-879333cfcb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:21.087284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-200f4ab6-ee96-4b97-9497-ae969e31381e req-2ff35f54-205e-4628-8cbe-879333cfcb12 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.087763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-200f4ab6-ee96-4b97-9497-ae969e31381e req-2ff35f54-205e-4628-8cbe-879333cfcb12 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.088382 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-200f4ab6-ee96-4b97-9497-ae969e31381e req-2ff35f54-205e-4628-8cbe-879333cfcb12 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.114154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-200f4ab6-ee96-4b97-9497-ae969e31381e req-2ff35f54-205e-4628-8cbe-879333cfcb12 service nova] Creating event network-changed:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:44:21.121771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-200f4ab6-ee96-4b97-9497-ae969e31381e req-2ff35f54-205e-4628-8cbe-879333cfcb12 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048852 Oct 20 14:44:21.122658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 211/414] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:21.144688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:21.145513 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:21.152873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.153448 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.153967 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.154745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.155497 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.156074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.303647 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:21.306513 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:21.311090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:21.312956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.313438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.313865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.314582 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.315027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.315446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.319125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-35f352fb-2a2b-472f-9488-39c4520d558c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.178273 Oct 20 14:44:21.319914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 204/415] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:21 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:21.356049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9dea85c6-cb5d-4290-b62c-0d9a1225caa9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056703 Oct 20 14:44:21.356671 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 212/416] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:21 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:21.611552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:21.612206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:21.618857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.619321 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.619823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.621571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.622045 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.622541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.671093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:21.671702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:21.677653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.678138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.678571 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.679262 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:21.679719 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:21.680143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:21.816749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:21.827973 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1351f61f-face-48e9-bf73-6275253fff37 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1516 microversion: 2.1 time: 0.221031 Oct 20 14:44:21.828741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 205/417] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:21 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1516 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:21.863085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:21.876752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bfc8eb63-ed34-4c34-bd5f-f94e954e5902 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.209352 Oct 20 14:44:21.886212 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 213/418] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:21 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:22.347320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:22.348738 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:22.360386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:22.360941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:22.361324 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:22.362031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:22.362666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:22.363271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:22.373474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:22.375921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:22.383474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:22.384146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:22.384686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:22.386451 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:22.387136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:22.387635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:22.437367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-073cd04e-8fac-4fe9-8030-c97ccd5e1ebb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071702 Oct 20 14:44:22.438214 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 214/419] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:22 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:22.513336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:22.521415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1ff71b03-4185-4a74-be44-9870a758da16 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.178140 Oct 20 14:44:22.522039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 206/420] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:22 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:22.899776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:22.900394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:22.907218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:22.907687 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:22.908122 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:22.908830 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:22.909275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:22.909689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:23.047439 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:23.055398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4ce6d369-fdf3-4c7e-8455-45b33ed1ea80 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.159403 Oct 20 14:44:23.055977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 215/421] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:22 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:23.225577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6e64d557-55e3-4dda-8aec-e7dff376f1dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'create', calling method: .version_select at 0x7f6344f47ee0>, body: {"keypair": {"name": "tempest-keypair-1215214718", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAV+okrOhUmzmI+ZUJXxjR7bJjo5dR+XGsXCXbe7tmzEVEpgsA2Sq2U5qXTamwxfCBTyzqpPZLVsHeDg4fOzqCV0psiIRoJd5IUBBBsNGcSvvgVdXyAexzNy6L7N/j89oA=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:23.242607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-6e64d557-55e3-4dda-8aec-e7dff376f1dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:23.247286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-6e64d557-55e3-4dda-8aec-e7dff376f1dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for user ae94a3ece5f644c6893589a1df84d1c6 and project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:23.272463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6e64d557-55e3-4dda-8aec-e7dff376f1dc tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050624 Oct 20 14:44:23.276524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 207/422] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:44:23 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:23.451175 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:23.454496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:23.463227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:23.464197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:23.464901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:23.465827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:23.466489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:23.467403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:23.472462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:23.505175 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8a347f11-91b1-4c97-92b3-66bc0d1234b7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058726 Oct 20 14:44:23.510403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 216/423] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:23 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:23.544941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:23.546305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:23.553264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:23.553751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:23.554177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:23.554870 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:23.555314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:23.555730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:23.723606 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:23.734534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f8d168fd-ebba-4748-af81-0fac22b63f0a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.193782 Oct 20 14:44:23.736158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 208/424] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:23 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:24.080191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:24.080839 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:24.087070 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:24.087565 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:24.088004 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:24.093251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:24.093747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:24.094190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:24.203532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:24.223905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:24.315853 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:24.327938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-291ea3d2-0d59-49f2-a9dd-5f8cc856f82b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.251616 Oct 20 14:44:24.328916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 217/425] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:24 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:24.519530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:24.522017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:24.529955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:24.530790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:24.531263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:24.532256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:24.533035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:24.533721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:24.566701 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-eb6a709b-d0dc-4309-a679-fcae1963bf80 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052071 Oct 20 14:44:24.567480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 209/426] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:24 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:24.734861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1421407459", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "c28ca665-bebd-48d6-918c-3a77995d0c6e"}], "security_groups": [{"name": "tempest-securitygroup--1318339375"}], "key_name": "tempest-keypair-1215214718", "user_data": "}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:24.761274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:24.762111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:24.769492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:24.770420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:24.771310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:24.772250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:24.772951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:24.773385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:24.890060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] validate_networks() for [('c28ca665-bebd-48d6-918c-3a77995d0c6e', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:44:25.013304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:25.024689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6da1f0e7-47c6-42c8-bcc7-a37aa581949c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.267796 Oct 20 14:44:25.036618 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 210/427] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:24 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:25.334742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:44:25.335161 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:44:25.335630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:44:25.336056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:44:25.336496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:44:25.348375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:25.348869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:25.349420 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:25.350683 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:25.351482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:25.352249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:25.360731 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:25.361357 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:25.368034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:25.368543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:25.369133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:25.370594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:25.371405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:25.371838 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:25.372317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:25.378749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Getting quotas for user ae94a3ece5f644c6893589a1df84d1c6 and project 7688b0fbf84b4f4f9c21cb4112ee53b5. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:25.392958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:44:25.395263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:44:25.427177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:25.452480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c48d2e9d-3802-4ec4-98f7-38b55f0d8819 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.722632 Oct 20 14:44:25.459940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 218/428] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:44:24 2022] POST /compute/v2.1/servers => generated 409 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 14:44:25.465849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-244ec3db-72ba-48f7-9c1f-025fbdfdae6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:25.466468 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-244ec3db-72ba-48f7-9c1f-025fbdfdae6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:25.537038 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-244ec3db-72ba-48f7-9c1f-025fbdfdae6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:25.548506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-244ec3db-72ba-48f7-9c1f-025fbdfdae6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1246 microversion: 2.1 time: 0.086819 Oct 20 14:44:25.554184 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 219/429] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:25 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1246 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:25.579795 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:25.582230 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:25.593634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:25.594134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:25.594571 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:25.595285 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:25.595743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:25.596166 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:25.657697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e52141dd-d153-456f-b47e-57f93120a248 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081963 Oct 20 14:44:25.662567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 220/430] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:25 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:25.941884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:25.956929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4ba5a8d9-2156-421c-99b2-ba8f14f1c4bb tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.603223 Oct 20 14:44:25.957523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 211/431] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:25 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 605 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:26.051688 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:26.052311 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:26.062169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.062776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.063407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.064269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.064944 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.065369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.203689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:26.215046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-834de8e2-ef23-4baf-8386-632e072a6e6b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.167579 Oct 20 14:44:26.215631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 221/432] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:26 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:26.582731 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:26.583254 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:26.590820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.591309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.591738 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.592674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.593126 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.593548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.656243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:26.666688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e4176f79-61ee-4ef1-b3ce-0ec49e853cb0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1250 microversion: 2.1 time: 0.087701 Oct 20 14:44:26.667869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 212/433] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:26 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1250 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:26.671123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:26.674106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:26.680591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.681497 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.683444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.684338 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.684891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.685384 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.717542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f75be5de-3aaf-4587-a7bf-8c6318b0856c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051582 Oct 20 14:44:26.718123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 222/434] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:26 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:26.980166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:26.980948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:26.987416 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.988134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.988839 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:26.989776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:26.990477 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:26.991263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.127978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:27.136954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-124f422c-5a17-445c-a38d-37c3435fd92a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.161043 Oct 20 14:44:27.137732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 213/435] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:26 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:27.239259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:27.239957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:27.242863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 14:44:27.243114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Thu Oct 20 14:44:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad (ip 10.222.0.13) !!! Oct 20 14:44:27.250946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:27.251634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:27.252170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.252980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:27.253501 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:27.254011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.396683 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:27.405157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-48c56fce-e8eb-4bca-9a0e-9288c16e681c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.169882 Oct 20 14:44:27.405747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 223/436] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:27 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:27.690571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:27.691193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:27.697515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:27.698195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:27.699129 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.699842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:27.700295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:27.700758 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.733246 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:27.735519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:27.742524 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:27.743337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:27.743835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.744682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:27.745276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:27.745764 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:27.770684 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:27.781278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b5c04ad3-e936-4477-bc74-1c709f2b5636 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1250 microversion: 2.1 time: 0.095214 Oct 20 14:44:27.788440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-589d15b7-355e-4622-b5d2-684bd748ec1b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058786 Oct 20 14:44:27.788440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 224/437] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:27 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:27.788736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 214/438] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:27 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1250 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:28.160628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:28.161153 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:28.167495 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.167982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.168441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.169143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.169596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.170025 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.306411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:28.315158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9c480d25-010d-4715-a32a-4a853862db0b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.158437 Oct 20 14:44:28.315744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 225/439] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:28 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:28.429194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:28.430753 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:28.437306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.437794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.438233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.438943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.439396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.439828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.444127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:28.574826 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:28.582827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d6e297d5-cec3-4b81-abe5-7a11b8e214e1 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.158027 Oct 20 14:44:28.583418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 215/440] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:28 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:28.799291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:28.801992 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:28.805363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:28.805976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:28.809106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.809768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.810330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.811080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.811635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.812132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.812244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.812733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.813167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.813858 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:28.814310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:28.814731 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:28.844263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f811d020-8cf2-4039-ab62-2bb0dbd06632 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048884 Oct 20 14:44:28.845194 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 226/441] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:28 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:28.883386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:28.892086 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-21f1120d-4fee-46b4-9d5b-f80494dd275f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1250 microversion: 2.1 time: 0.090336 Oct 20 14:44:28.892703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 216/442] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:28 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1250 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:29.338864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:29.339422 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:29.346928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.347492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.347997 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.352867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.352867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.352867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.498215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:29.505993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e14c9125-fd2b-473f-99b2-98dbf4890530 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.171153 Oct 20 14:44:29.506563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 227/443] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:29 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:29.607477 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:29.608290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:29.614314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.614877 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.615263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.615925 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.616394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.616817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.750429 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:29.758081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-94748ec5-9cbb-40d7-8c2a-eb7b1543ac40 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.155041 Oct 20 14:44:29.758645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 217/444] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:29 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:29.858028 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:29.860098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:29.866080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.866561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.866996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.867684 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.868164 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.868615 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.897912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d03c8339-923e-414a-acfa-6445b9287699 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044875 Oct 20 14:44:29.898458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 228/445] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:29 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:29.916007 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:29.917780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:29.924061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.924604 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.925036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.925720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:29.926169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:29.926591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:29.990179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:29.998631 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-154b9d68-fa2d-4717-aa71-53b7a7b84d72 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1250 microversion: 2.1 time: 0.086470 Oct 20 14:44:29.999200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 218/446] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:29 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1250 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:30.529104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:30.529719 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:30.536672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:30.537156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:30.537592 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:30.538278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:30.538728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:30.539150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:30.665951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:30.673582 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-aaa017b4-9dc4-42fc-86a4-ef15bd00cad7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.148649 Oct 20 14:44:30.674142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 229/447] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:30 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:30.780749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:30.781287 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:30.787240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:30.787720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:30.788154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:30.788868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:30.789322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:30.789750 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:30.910901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:30.913236 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:30.924282 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:30.926713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:30.927210 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:30.928131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:30.928893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:30.929409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:30.929833 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:30.936403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9e020ae6-1122-4913-9bbe-9da7385e1c23 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1677 microversion: 2.1 time: 0.159384 Oct 20 14:44:30.938142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 219/448] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:30 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1677 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:30.965487 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-12d4c5c6-36f9-493a-aab9-e6c467669119 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058388 Oct 20 14:44:30.966101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 230/449] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:30 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:31.024721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:31.026005 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:31.034615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.035504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.036290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.037760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.038436 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.038987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.109931 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:31.122583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7a78b3ef-ec94-4926-ab2f-5049f466388a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1298 microversion: 2.1 time: 0.102869 Oct 20 14:44:31.123170 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 220/450] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:31 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1298 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:31.700165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:31.700815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:31.707820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.708305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.708768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.709467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.709938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.710548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.909956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:31.918081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1f725b8d-b7a6-4792-924d-e4d847d6e189 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.225070 Oct 20 14:44:31.919094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 231/451] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:31 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:31.960860 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:31.961440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:31.968509 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.968994 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.969445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.970123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.970578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.971013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.977353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:31.979579 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:31.986413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.986902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.987336 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:31.988027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:31.988510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:31.988942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.024025 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3eb2528c-eb8f-4005-8d5d-1896139167b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050344 Oct 20 14:44:32.024918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 232/452] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:44:31 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 14:44:32.098660 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:32.099620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:32.106172 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.106986 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.107492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.108561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.109396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.109897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.120213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:32.129917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ae6eec94-79cf-481f-adac-a03b9db938a9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1654 microversion: 2.1 time: 0.172889 Oct 20 14:44:32.130508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 221/453] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:31 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1654 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:32.140628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:44:32.149496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:32.150458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:32.159615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.160295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.160973 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.161914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.162602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.163463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.174151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:32.230811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0c9fa3c0-9726-4ec9-a274-0a9f855f413f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 204 len: 0 microversion: 2.1 time: 0.135117 Oct 20 14:44:32.231396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 233/454] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:44:32 2022] DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 14:44:32.237805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9504ac16-7f6f-4a00-ae92-61b749d3bdcf tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:32.238951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:32.243873 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9504ac16-7f6f-4a00-ae92-61b749d3bdcf tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.244442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9504ac16-7f6f-4a00-ae92-61b749d3bdcf tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.244866 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9504ac16-7f6f-4a00-ae92-61b749d3bdcf tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.247055 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0eb572fb-62cc-405a-a4d4-1a1eac83fab4 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1304 microversion: 2.1 time: 0.103083 Oct 20 14:44:32.247643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 222/455] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:32 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1304 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:32.265144 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:32.266748 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:32.269249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9504ac16-7f6f-4a00-ae92-61b749d3bdcf tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Going to try to start instance {{(pid=125811) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 20 14:44:32.274484 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.274484 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.274484 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.275215 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.275674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.276255 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.314296 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9504ac16-7f6f-4a00-ae92-61b749d3bdcf tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action" status: 202 len: 0 microversion: 2.1 time: 0.081450 Oct 20 14:44:32.315321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 234/456] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:44:32 2022] POST /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:32.324713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:32.325421 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:32.334448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.334942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.335375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.336077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.336584 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.341003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.458026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:32.466304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-28786f39-32b2-4a4e-840a-e5d5d5df8185 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1680 microversion: 2.1 time: 0.208847 Oct 20 14:44:32.467095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 223/457] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:32 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1680 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:32.503149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:32.510971 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3fcdc627-c137-400e-9341-c375aeda0553 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1663 microversion: 2.1 time: 0.191224 Oct 20 14:44:32.528160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 235/458] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:32 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1663 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:32.943130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:32.943744 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:32.950289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.950770 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.951205 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:32.951895 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:32.952361 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:32.952804 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.086782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:33.095873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-650b0a94-b4d0-427f-b92a-793058cfa2c0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.156559 Oct 20 14:44:33.096716 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 224/459] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:32 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:33.274707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:33.275364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:33.282536 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.282957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.283380 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.284054 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.284523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.284941 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.417651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:33.426577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e2ce38e7-67aa-4cac-a528-d559c48cefc8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.155677 Oct 20 14:44:33.427428 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 236/460] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:33 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:33.490120 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:33.491290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:33.494420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=10 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:33.499860 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.500470 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.500992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.501785 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.502305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.502796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.534977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:33.535589 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:33.542593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.543287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.543721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.544518 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.544968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.545448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.707446 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:33.715568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-97cf2a5e-d71d-4251-b0c9-7a0bb382c2cb tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1680 microversion: 2.1 time: 0.229504 Oct 20 14:44:33.716217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 225/461] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:33 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1680 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:33.721305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-b5429037-2751-497e-926c-fbdfe5f56268 req-cd51eccf-d68b-48e4-b863-71c65edffc4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824af68b-a192-4a4d-8058-1ab7086ef986", "tag": "d15efa7b-2d55-44cf-a379-eaaae6f4f141"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:33.731298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b5429037-2751-497e-926c-fbdfe5f56268 req-cd51eccf-d68b-48e4-b863-71c65edffc4d service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:33.731960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b5429037-2751-497e-926c-fbdfe5f56268 req-cd51eccf-d68b-48e4-b863-71c65edffc4d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:33.732492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b5429037-2751-497e-926c-fbdfe5f56268 req-cd51eccf-d68b-48e4-b863-71c65edffc4d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:33.741180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:33.744728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-b5429037-2751-497e-926c-fbdfe5f56268 req-cd51eccf-d68b-48e4-b863-71c65edffc4d service nova] Creating event network-changed:d15efa7b-2d55-44cf-a379-eaaae6f4f141 for instance 824af68b-a192-4a4d-8058-1ab7086ef986 on hv-cinder-77923 Oct 20 14:44:33.749869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-b5429037-2751-497e-926c-fbdfe5f56268 req-cd51eccf-d68b-48e4-b863-71c65edffc4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032287 Oct 20 14:44:33.750470 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 226/462] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:33.750804 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d7c2c5dc-bf69-4b5c-be4f-3b9688945a1d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1663 microversion: 2.1 time: 0.219484 Oct 20 14:44:33.751392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 237/463] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:33 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1663 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:34.120599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:34.121369 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:34.127846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.128301 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.128884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.129529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.130013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.130439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.257780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:34.265579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-62543935-f549-4948-9add-334b7de69968 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.149742 Oct 20 14:44:34.266185 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 227/464] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:34 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:34.451206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:34.451855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:34.458463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.459058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.459511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.460268 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.460932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.461510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.600112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:34.608887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ae6fa216-509d-466d-8a1e-e79bde462738 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.162645 Oct 20 14:44:34.609456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 238/465] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:34 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:34.741916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:34.742787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:34.749347 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.749831 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.750262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.750992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.751443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.751868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.773721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:34.774334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:34.781263 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.781749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.782183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:34.782883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:34.783333 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:34.783754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:35.041782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:35.051512 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0ca6f943-ef10-4633-a333-2666626613f3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1680 microversion: 2.1 time: 0.315275 Oct 20 14:44:35.064729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 228/466] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:34 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1680 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:35.072931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:35.081874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e7d2b793-56b3-4f07-8951-e4a2aec87ed5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1663 microversion: 2.1 time: 0.311866 Oct 20 14:44:35.084395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 239/467] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:34 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1663 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:35.289063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:35.289690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:35.297019 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:35.297823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:35.298265 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:35.298990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:35.299444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:35.300064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:35.500199 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:35.507853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-21d328b5-7310-4ffa-b94e-24f23ae1ba2f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.222789 Oct 20 14:44:35.508428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 229/468] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:35 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:35.633812 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:35.634454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:35.637007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:35.638423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=8 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:35.644413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:35.644901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:35.645359 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:35.646065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:35.646506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:35.646923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:35.780459 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:35.788245 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f35ddb73-4715-4f23-93bd-3a9370321746 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.158527 Oct 20 14:44:35.788843 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 240/469] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:35 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:36.075157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:36.075813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:36.082264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.082961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.083402 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.084240 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.084723 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.085146 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.106607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:36.108767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:36.116964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.117728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.118682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.119539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.120276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.121596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.172768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:36.181405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-68e86ec6-460c-41b6-a295-f1c0b34428f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1613 microversion: 2.1 time: 0.110204 Oct 20 14:44:36.182901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 230/470] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:36 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1613 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:36.271945 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-c61d03f4-91ae-4ee9-a5cd-5d72890c5deb req-93cb08c3-350a-48d3-b4eb-2e59bc483032 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da8d0a95-894e-4244-9a27-6b86a1b5ca83", "name": "network-vif-deleted", "tag": "516e6fb9-5c7c-44bb-b65b-facb0026c92b"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:36.274365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:36.281610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c61d03f4-91ae-4ee9-a5cd-5d72890c5deb req-93cb08c3-350a-48d3-b4eb-2e59bc483032 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.282087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c61d03f4-91ae-4ee9-a5cd-5d72890c5deb req-93cb08c3-350a-48d3-b4eb-2e59bc483032 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.282619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c61d03f4-91ae-4ee9-a5cd-5d72890c5deb req-93cb08c3-350a-48d3-b4eb-2e59bc483032 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.283664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e4b990f1-6b86-42c6-a4a6-35dc2e19f8e3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1663 microversion: 2.1 time: 0.182739 Oct 20 14:44:36.284250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 241/471] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:36 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1663 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:36.295170 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-c61d03f4-91ae-4ee9-a5cd-5d72890c5deb req-93cb08c3-350a-48d3-b4eb-2e59bc483032 service nova] Creating event network-vif-deleted:516e6fb9-5c7c-44bb-b65b-facb0026c92b for instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 on hv-cinder-77923 Oct 20 14:44:36.300800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-c61d03f4-91ae-4ee9-a5cd-5d72890c5deb req-93cb08c3-350a-48d3-b4eb-2e59bc483032 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032377 Oct 20 14:44:36.301403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 231/472] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:36.319979 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-fee6cd6d-db68-424f-9b85-091dcd60909a req-fb9cb060-2f9f-4f64-bd34-96c1a0609ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "name": "network-vif-plugged", "status": "completed", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:36.331823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-fee6cd6d-db68-424f-9b85-091dcd60909a req-fb9cb060-2f9f-4f64-bd34-96c1a0609ea3 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.332376 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-fee6cd6d-db68-424f-9b85-091dcd60909a req-fb9cb060-2f9f-4f64-bd34-96c1a0609ea3 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.332872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-fee6cd6d-db68-424f-9b85-091dcd60909a req-fb9cb060-2f9f-4f64-bd34-96c1a0609ea3 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.352436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-fee6cd6d-db68-424f-9b85-091dcd60909a req-fb9cb060-2f9f-4f64-bd34-96c1a0609ea3 service nova] Creating event network-vif-plugged:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:44:36.359857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-fee6cd6d-db68-424f-9b85-091dcd60909a req-fb9cb060-2f9f-4f64-bd34-96c1a0609ea3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044735 Oct 20 14:44:36.361005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 242/473] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:36.532930 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:36.533646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:36.539719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.540207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.540675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.541373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.541827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.542257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.676947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:36.684734 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-70b04e6a-4699-422d-8587-8c493eefb733 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.156179 Oct 20 14:44:36.685306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 232/474] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:36 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:36.812880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:36.813568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:36.820084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.820608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.821033 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.821718 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:36.822197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:36.822613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:36.950978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:36.958717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-31fe48fe-0b1f-4395-86ef-4ad87bba02a3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.150642 Oct 20 14:44:36.959301 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 243/475] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:36 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:37.205922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:37.206537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:37.208520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:37.213619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.214102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.215563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.216254 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.216739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.217168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.222099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:37.284697 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:37.292492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dbbbb215-a25f-4055-81a9-17f8616f601c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1613 microversion: 2.1 time: 0.090366 Oct 20 14:44:37.294112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 233/476] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:37 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1613 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:37.308244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:37.309095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:37.315443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.315964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.316325 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.317039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.317486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.317900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.461661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:37.471063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ab0d5892-1169-4da1-8eed-ccf5035fc85c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1667 microversion: 2.1 time: 0.167105 Oct 20 14:44:37.471380 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 244/477] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:37 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1667 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:37.707079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:37.707696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:37.714017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.715644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.716195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.717043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.717371 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.717799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.843972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:37.851572 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4b00ec71-301d-40a9-83d3-3b97fe11c251 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.148531 Oct 20 14:44:37.852135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 234/478] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:37 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:37.981940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:37.982842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:37.989288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.989778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.990247 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:37.990949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:37.991407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:37.991834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:38.132994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:38.140949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-693d231e-473b-421c-aaf6-171abd66ba2e tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.162866 Oct 20 14:44:38.141530 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 245/479] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:37 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:38.318830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:38.319439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:38.325997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:38.326474 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:38.326899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:38.327584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:38.328029 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:38.328483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:38.359537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:38.360015 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:38.360482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:38.360923 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'fault' on Instance uuid da8d0a95-894e-4244-9a27-6b86a1b5ca83 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:38.400715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:38.409108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2dfd0617-ca20-437a-979e-3d3b310fa9d0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 200 len: 1331 microversion: 2.1 time: 0.094165 Oct 20 14:44:38.409672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 235/480] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:38 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:38.875075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:38.875692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:38.881734 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:38.882226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:38.882662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:38.883361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:38.883816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:38.884244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:39.019621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:39.028624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-edba0a76-182d-406d-944c-840acae966db tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1359 microversion: 2.1 time: 0.158063 Oct 20 14:44:39.029199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 246/481] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:38 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:39.163876 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:39.164444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:39.170744 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:39.171217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:39.171650 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:39.172328 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:39.172801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:39.173221 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:39.301732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:39.309873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c3608347-91eb-415f-8066-d0b7e21a33d3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.149462 Oct 20 14:44:39.310955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 236/482] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:39 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:39.432069 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:39.432632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:39.438858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:39.439330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:39.439756 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:39.440481 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:39.440913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:39.441329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:39.454829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 HTTP/1.1 Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:44:39.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:44:39.457931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'da8d0a95-894e-4244-9a27-6b86a1b5ca83'} Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:44:39.458857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:44:39.460402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:44:39.461752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:44:39.461752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a77c6bb0-b9a4-492a-a610-30dd437b8926 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 404 len: 111 microversion: 2.1 time: 0.029827 Oct 20 14:44:39.461752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 247/483] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:39 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:44:39.467218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-592b752f-e45f-48ad-89f7-a1d826ede0b3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '.version_select at 0x7f6344daac10>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:39.486663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-592b752f-e45f-48ad-89f7-a1d826ede0b3 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411788643" status: 202 len: 0 microversion: 2.1 time: 0.023790 Oct 20 14:44:39.487223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 237/484] 10.222.0.13 () {58 vars in 1221 bytes} [Thu Oct 20 14:44:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1411788643 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:40.053861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:40.054483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:40.062417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.062898 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.063329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.064085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.064750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.065343 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.087825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-c5af5dfe-f9a4-41e4-ae0d-757047a94cec req-5c99803b-c413-41c0-b503-65ab48375c06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824af68b-a192-4a4d-8058-1ab7086ef986", "name": "network-vif-plugged", "status": "completed", "tag": "d15efa7b-2d55-44cf-a379-eaaae6f4f141"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:40.101390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c5af5dfe-f9a4-41e4-ae0d-757047a94cec req-5c99803b-c413-41c0-b503-65ab48375c06 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.102156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c5af5dfe-f9a4-41e4-ae0d-757047a94cec req-5c99803b-c413-41c0-b503-65ab48375c06 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.102803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c5af5dfe-f9a4-41e4-ae0d-757047a94cec req-5c99803b-c413-41c0-b503-65ab48375c06 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.116730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-c5af5dfe-f9a4-41e4-ae0d-757047a94cec req-5c99803b-c413-41c0-b503-65ab48375c06 service nova] Creating event network-vif-plugged:d15efa7b-2d55-44cf-a379-eaaae6f4f141 for instance 824af68b-a192-4a4d-8058-1ab7086ef986 on hv-cinder-77923 Oct 20 14:44:40.122750 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-c5af5dfe-f9a4-41e4-ae0d-757047a94cec req-5c99803b-c413-41c0-b503-65ab48375c06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041413 Oct 20 14:44:40.124282 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 238/485] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:40.130916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-893f0268-9a19-4174-9e8a-450650ac1837 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: .version_select at 0x7f6344e67550>, body: {"keypair": {"name": "tempest-keypair-1052121880", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOOW1/DSMnWRDasEDQwELNOZ3b19PJo+vS2jYHfogzqkcUbXHfynsvCBu2SYJj3i/SOZD93REeeqS2Hjftdsfq7F/lZFVTcTKZJJ1m10Cq8oH7TdyqjuklQ0JSLW1w3HA=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:40.151993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-893f0268-9a19-4174-9e8a-450650ac1837 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:40.156729 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-893f0268-9a19-4174-9e8a-450650ac1837 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:40.183033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-893f0268-9a19-4174-9e8a-450650ac1837 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.056919 Oct 20 14:44:40.185062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 239/486] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:44:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:40.235998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:40.245317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a3f0a72a-bc64-49ed-9ae3-234073ee2bc6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1548 microversion: 2.1 time: 0.197464 Oct 20 14:44:40.253519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 248/487] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:40 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1548 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:40.269287 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:40.269934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:40.276869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.277350 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.277780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.278991 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.279439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.279855 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.333825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:40.334540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:40.342209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.342706 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.343149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.343863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.344324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.344776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.453941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:40.461605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-12505dee-3431-42c1-9cd2-be2c209134a3 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1548 microversion: 2.1 time: 0.196213 Oct 20 14:44:40.462408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 240/488] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:40 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:40.484750 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:40.490012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:40.490793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Searching by: {'deleted': False, 'project_id': 'adc778cfb32049d5844da08c78ba014a'} {{(pid=125810) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 20 14:44:40.498624 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.499087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.499700 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.500398 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.500856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.501281 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.533687 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:40.538667 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=96,nova_cell1:INSERT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:40.546884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9928c3de-1afc-4edd-889c-7dcc49da9c19 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.216751 Oct 20 14:44:40.548820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 249/489] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:40 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:40.603819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.multi_cell_list [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=125810) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 20 14:44:40.706922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c4ac1301-dc56-4e73-872a-6600b104ebd0 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.227336 Oct 20 14:44:40.707521 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 241/490] 10.222.0.13 () {58 vars in 1125 bytes} [Thu Oct 20 14:44:40 2022] GET /compute/v2.1/servers => generated 343 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:40.720040 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:40.720684 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:40.728332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.728895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.729329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.730131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:40.730585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:40.731004 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:40.936892 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:40.944581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e1942f51-f4d1-41bc-9596-1ed950457d9a tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1548 microversion: 2.1 time: 0.229212 Oct 20 14:44:40.945151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 250/491] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:40 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1548 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:41.573368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:41.574103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:41.580847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:41.581411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:41.581916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:41.582705 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:41.583234 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:41.583732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:41.596593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1214760336", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc51d155-90b9-48b7-86e9-fc4346955e9e"}], "security_groups": [{"name": "tempest-securitygroup--495258526"}], "key_name": "tempest-keypair-1052121880", "user_data": "}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:41.733491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] validate_networks() for [('bc51d155-90b9-48b7-86e9-fc4346955e9e', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:44:41.759367 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:41.767522 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dcd34d46-fd4c-4eda-80d9-35e071b4dc96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1372 microversion: 2.1 time: 0.198993 Oct 20 14:44:41.768094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 242/492] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:41 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1372 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:42.100017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:44:42.100463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:44:42.100938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:44:42.101344 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:44:42.101747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:44:42.111177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:42.111656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:42.112080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:42.112834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:42.113283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:42.113701 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:42.130600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:42.134556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:42.145659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:44:42.147885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:44:42.195962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ab67e176-e88b-4ae3-90f6-596f9e01aa91 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.603574 Oct 20 14:44:42.196644 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 251/493] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:44:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 14:44:42.207500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-66da9487-4834-4394-8e87-14339c41aa72 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:42.208112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-66da9487-4834-4394-8e87-14339c41aa72 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:42.526101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-66da9487-4834-4394-8e87-14339c41aa72 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:42.535539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-66da9487-4834-4394-8e87-14339c41aa72 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1242 microversion: 2.1 time: 0.331718 Oct 20 14:44:42.536166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 243/494] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:42 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1242 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:42.577949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a7769d61-901f-49dc-ad78-9307c978699b"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:42.580377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:42.586685 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:42.587163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:42.587591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:42.588278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:42.588748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:42.589163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:42.790581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:42.791184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:42.798393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:42.798873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:42.799301 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:42.799995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:42.800471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:42.800895 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:42.846259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a0d5162d-2a24-47b5-9bd6-00be62f72d50 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.272837 Oct 20 14:44:42.847291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 252/495] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:44:42 2022] POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:42.967664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:42.975727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-97dfe55b-ed5d-4363-8cb7-c0607a48286a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1567 microversion: 2.1 time: 0.189273 Oct 20 14:44:42.976532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 244/496] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:42 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:43.001235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:43.001809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:43.008802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:43.009283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:43.009890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:43.010767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:43.011218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:43.011655 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:43.097730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ba836405-b0d3-46cf-8556-a4412a11fd35 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.101038 Oct 20 14:44:43.098322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 253/497] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:44:42 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-interface => generated 285 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:43.561739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:43.562355 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:43.568760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:43.569452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:43.569884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:43.570600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:43.571264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:43.571723 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:43.658681 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:43.671173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ae9d4e31-6da8-4c43-8d57-57c3e9aeec18 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1294 microversion: 2.1 time: 0.114422 Oct 20 14:44:43.672588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 245/498] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:43 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1294 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:44.075633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-60a38262-7ca8-412d-9972-861499deb0d2 req-177f7a37-f0ea-435f-8bf8-46dd146b33b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824af68b-a192-4a4d-8058-1ab7086ef986", "tag": "d15efa7b-2d55-44cf-a379-eaaae6f4f141"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:44.085868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-60a38262-7ca8-412d-9972-861499deb0d2 req-177f7a37-f0ea-435f-8bf8-46dd146b33b2 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:44.086436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-60a38262-7ca8-412d-9972-861499deb0d2 req-177f7a37-f0ea-435f-8bf8-46dd146b33b2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:44.087194 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-60a38262-7ca8-412d-9972-861499deb0d2 req-177f7a37-f0ea-435f-8bf8-46dd146b33b2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:44.099868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-60a38262-7ca8-412d-9972-861499deb0d2 req-177f7a37-f0ea-435f-8bf8-46dd146b33b2 service nova] Creating event network-changed:d15efa7b-2d55-44cf-a379-eaaae6f4f141 for instance 824af68b-a192-4a4d-8058-1ab7086ef986 on hv-cinder-77923 Oct 20 14:44:44.105355 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-60a38262-7ca8-412d-9972-861499deb0d2 req-177f7a37-f0ea-435f-8bf8-46dd146b33b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034551 Oct 20 14:44:44.106702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 254/499] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:44.695308 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:44.696682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:44.705072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:44.706034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:44.706853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:44.708070 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:44.708890 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:44.709807 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:44.875952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:44.884245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bb21bb1b-1a6f-4b23-85dc-9d18a6deb650 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.192816 Oct 20 14:44:44.885284 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 246/500] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:44 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:45.828858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-837f5db8-833d-4dbf-82b7-fc7415cd4a32 req-b24d5c18-8589-4986-b349-54941bcca537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7254508-d290-4971-a856-7c9afb57161b", "tag": "813487db-4806-4570-a1f7-f8c76f352e9e"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:45.834592 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:INSERT=6,nova_api:SELECT=93,nova_api:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:45.841358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-837f5db8-833d-4dbf-82b7-fc7415cd4a32 req-b24d5c18-8589-4986-b349-54941bcca537 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:45.842184 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-837f5db8-833d-4dbf-82b7-fc7415cd4a32 req-b24d5c18-8589-4986-b349-54941bcca537 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:45.842782 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-837f5db8-833d-4dbf-82b7-fc7415cd4a32 req-b24d5c18-8589-4986-b349-54941bcca537 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:45.854861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-837f5db8-833d-4dbf-82b7-fc7415cd4a32 req-b24d5c18-8589-4986-b349-54941bcca537 service nova] Creating event network-changed:813487db-4806-4570-a1f7-f8c76f352e9e for instance c7254508-d290-4971-a856-7c9afb57161b on hv-cinder-77923 Oct 20 14:44:45.860160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-837f5db8-833d-4dbf-82b7-fc7415cd4a32 req-b24d5c18-8589-4986-b349-54941bcca537 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036551 Oct 20 14:44:45.860968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 255/501] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:45.907370 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:45.908078 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:45.914187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:45.914770 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:45.915271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:45.916029 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:45.916623 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:45.917125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:46.045635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:46.054167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-75b07b72-1984-456c-9d54-9f42c2c717f9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.151014 Oct 20 14:44:46.054739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 247/502] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:45 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:46.953106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:46.953669 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:46.960461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:46.960925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:46.961361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:46.962042 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:46.962491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:46.962911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:46.994309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a0ab0b96-c5b1-4b40-8e98-bd13f2b1769e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments/5e2346b5-78ce-440d-b085-8eb6d76a8e20" status: 200 len: 194 microversion: 2.20 time: 0.046254 Oct 20 14:44:46.994892 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 256/503] 10.222.0.13 () {60 vars in 1454 bytes} [Thu Oct 20 14:44:46 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments/5e2346b5-78ce-440d-b085-8eb6d76a8e20 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:44:47.062325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:47.062852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:47.068963 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:47.069448 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:47.069887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:47.070584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:47.071042 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:47.071469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:47.076955 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:47.077558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:47.083302 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:47.083778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:47.084202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:47.084918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:47.085365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:47.085788 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:47.156444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lazy-loading 'services' on Instance uuid a8a24968-9e6f-4fd7-9942-87adf39c1cc0 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:47.229174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:47.235358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7b065aa4-838f-41c6-835b-58aac91180f3 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments/5e2346b5-78ce-440d-b085-8eb6d76a8e20" status: 202 len: 0 microversion: 2.20 time: 0.176875 Oct 20 14:44:47.236166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 248/504] 10.222.0.13 () {60 vars in 1457 bytes} [Thu Oct 20 14:44:47 2022] DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments/5e2346b5-78ce-440d-b085-8eb6d76a8e20 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:44:47.238137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-df72d502-37b1-4266-bfa4-35752ddf4603 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.164979 Oct 20 14:44:47.238864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 257/505] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:47 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:47.245179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:47.248287 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:47.254401 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:47.254880 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:47.255308 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:47.255992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:47.256459 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:47.257035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:47.285328 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-44999a81-832c-4df1-a562-69d222416d4d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044245 Oct 20 14:44:47.285870 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 249/506] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Oct 20 14:44:47 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:44:48.260683 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:48.261291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:48.268500 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:48.268980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:48.269408 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:48.270088 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:48.270535 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:48.270960 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:48.298687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:48.300897 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:48.307300 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:48.307709 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:48.308136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:48.308851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:48.309868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:48.310336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:48.341598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6c3218d9-195e-4807-87cc-046e929dec80 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046735 Oct 20 14:44:48.342290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 250/507] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Oct 20 14:44:48 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 20 14:44:48.405705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:48.414104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-aef8a443-c06f-4ac7-8e60-23d76703033c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.157057 Oct 20 14:44:48.414596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 258/508] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:48 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:49.353819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:49.356582 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:49.363340 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:49.363820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:49.364247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:49.364957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:49.365408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:49.365829 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:49.394611 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-945cae14-b6c7-4fd7-b8cc-ce030599a1be tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Oct 20 14:44:49.395157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 251/509] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Oct 20 14:44:49 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:44:49.436059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:49.436708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:49.443142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:49.443612 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:49.444114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:49.444829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:49.445276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:49.445692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:49.575976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:49.584558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0957b75d-1daf-487d-a334-120d81ed3818 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.152081 Oct 20 14:44:49.585300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 259/510] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:49 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:50.143112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-e2512175-094a-4882-9c6c-d867109669de req-3131d48c-975d-4d47-bc07-5a48cbcf7dbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7254508-d290-4971-a856-7c9afb57161b", "name": "network-vif-plugged", "status": "completed", "tag": "813487db-4806-4570-a1f7-f8c76f352e9e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:50.158268 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e2512175-094a-4882-9c6c-d867109669de req-3131d48c-975d-4d47-bc07-5a48cbcf7dbd service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.164675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e2512175-094a-4882-9c6c-d867109669de req-3131d48c-975d-4d47-bc07-5a48cbcf7dbd service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.165224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e2512175-094a-4882-9c6c-d867109669de req-3131d48c-975d-4d47-bc07-5a48cbcf7dbd service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.169832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:50.178363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-e2512175-094a-4882-9c6c-d867109669de req-3131d48c-975d-4d47-bc07-5a48cbcf7dbd service nova] Creating event network-vif-plugged:813487db-4806-4570-a1f7-f8c76f352e9e for instance c7254508-d290-4971-a856-7c9afb57161b on hv-cinder-77923 Oct 20 14:44:50.183457 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-e2512175-094a-4882-9c6c-d867109669de req-3131d48c-975d-4d47-bc07-5a48cbcf7dbd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044539 Oct 20 14:44:50.184749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 252/511] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:50.407304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:50.410637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:50.417238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.417927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.418466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.420489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.420968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.421591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.481163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-489e8fce-b658-4517-96c9-00bee95bca30 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.076816 Oct 20 14:44:50.484432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 260/512] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Oct 20 14:44:50 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:44:50.491956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:50.492691 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:50.501026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.502179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.502708 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.504081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.504684 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.505357 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.537116 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:50.608620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:50.609323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:50.615223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.615769 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.616269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.617042 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:50.617560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:50.618098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:50.636050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:50.645487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d20b4004-7e3c-4f35-95ca-c33bfaa49ad6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1594 microversion: 2.1 time: 0.158979 Oct 20 14:44:50.646067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 253/513] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:50 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1594 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:50.750563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:50.763066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-723eed8a-eb05-44aa-b0ff-66cd5fda72b6 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.157811 Oct 20 14:44:50.764310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 261/514] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:50 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:51.495770 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:51.498526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:51.505146 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.505635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.506070 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.506773 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.507224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.507646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.538906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-48c292da-6cbd-4657-be5b-ddc370506183 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046999 Oct 20 14:44:51.539403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 254/515] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Oct 20 14:44:51 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:51.604991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:51.606023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:51.613250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.613754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.614196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.614868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.615324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.615740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.641208 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:44:51.715273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1fdd5828-d71b-44f7-87c8-10d63b1a7bae tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 204 len: 0 microversion: 2.20 time: 0.113863 Oct 20 14:44:51.716112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 262/516] 10.222.0.13 () {60 vars in 1280 bytes} [Thu Oct 20 14:44:51 2022] DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 14:44:51.724596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:51.725214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:51.732192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.733171 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.733414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.734162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.734622 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.735045 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.787627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:51.788329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:51.795751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.796103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.796569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.797278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:51.797732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:51.798158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:51.920853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:51.929467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:51.930901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:51.932062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-48b71272-ce8d-428c-9f1d-84dfd35a63f9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.211424 Oct 20 14:44:51.939791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 255/517] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:44:51 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:44:51.965296 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:51.974273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e16293cc-2f7c-42d8-becd-76bc2b9efeb8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1367 microversion: 2.1 time: 0.190885 Oct 20 14:44:51.974848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 263/518] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:51 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1367 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:44:52.332640 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-f3cd9ba8-75da-4977-bba7-ede2faad6f67 req-7dc875c8-a6e8-4500-82b0-48157b1d205b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:52.342415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f3cd9ba8-75da-4977-bba7-ede2faad6f67 req-7dc875c8-a6e8-4500-82b0-48157b1d205b service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:52.342899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f3cd9ba8-75da-4977-bba7-ede2faad6f67 req-7dc875c8-a6e8-4500-82b0-48157b1d205b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:52.343330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f3cd9ba8-75da-4977-bba7-ede2faad6f67 req-7dc875c8-a6e8-4500-82b0-48157b1d205b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:52.358146 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-f3cd9ba8-75da-4977-bba7-ede2faad6f67 req-7dc875c8-a6e8-4500-82b0-48157b1d205b service nova] Creating event network-changed:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:44:52.363696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-f3cd9ba8-75da-4977-bba7-ede2faad6f67 req-7dc875c8-a6e8-4500-82b0-48157b1d205b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035147 Oct 20 14:44:52.364654 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 256/519] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:52.959159 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:52.960368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:52.963518 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:52.964718 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:52.970210 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:52.970920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:52.971511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:52.972399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:52.973010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:52.973589 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.003050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:53.004429 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:53.009833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:53.015925 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:53.016680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:53.017308 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.018119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:53.018790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:53.019382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.217825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:53.223014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:53.229780 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:53.231116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:53.233509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3e7c1ba7-3ec5-479d-8986-32b75eddaa1c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.278191 Oct 20 14:44:53.236056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4c6e5586-6bd3-4f90-bdd5-f82397a4ccd0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1557 microversion: 2.1 time: 0.241268 Oct 20 14:44:53.236972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 257/520] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:52 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1557 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:53.240751 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 264/521] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:44:52 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:44:53.263457 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:53.264047 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:53.270864 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:53.271363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:53.271805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.272779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:53.273434 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:53.274025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.368975 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4cc9b4e1-18d2-4349-b095-62c413e3dfc9 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.110757 Oct 20 14:44:53.369574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 258/522] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:44:53 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:53.402737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1830182726"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:53.403462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:53.409555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:53.410144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:53.410694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.411475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:53.412023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:53.412569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:53.665852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.network.security_group_api [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Adding security group 85788e2a-e563-4b22-a334-f1d6f3aefa63 to port 7737f129-fde2-4080-b32b-e42c5e55b1b7 Oct 20 14:44:54.259994 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:54.260642 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:54.267988 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:54.268511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:54.268956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:54.269966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:54.270424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:54.270854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:54.588826 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:54.598548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:54.599997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:54.601535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-954b86fb-8661-40f9-8e8b-898aca24c90d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1725 microversion: 2.20 time: 0.346406 Oct 20 14:44:54.602105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 259/523] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:44:54 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1725 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:44:54.670032 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e517653c-168c-4481-bdc6-47e89676e087 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/action" status: 202 len: 0 microversion: 2.1 time: 1.270800 Oct 20 14:44:54.673981 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 265/524] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:44:53 2022] POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/action => generated 0 bytes in 1273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:44:54.686000 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:54.686620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:54.700987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:54.707116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-825da445-8eb2-46bf-aae6-83779ac15440 req-9c8f5ab6-83ec-424b-8618-cca76c1ab379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:54.714167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:54.714686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:54.715433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:54.715923 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:54.716492 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:54.723812 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-825da445-8eb2-46bf-aae6-83779ac15440 req-9c8f5ab6-83ec-424b-8618-cca76c1ab379 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:54.724290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-825da445-8eb2-46bf-aae6-83779ac15440 req-9c8f5ab6-83ec-424b-8618-cca76c1ab379 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:54.724741 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-825da445-8eb2-46bf-aae6-83779ac15440 req-9c8f5ab6-83ec-424b-8618-cca76c1ab379 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:54.753107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:44:54.755511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-825da445-8eb2-46bf-aae6-83779ac15440 req-9c8f5ab6-83ec-424b-8618-cca76c1ab379 service nova] Creating event network-changed:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:44:54.760929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-825da445-8eb2-46bf-aae6-83779ac15440 req-9c8f5ab6-83ec-424b-8618-cca76c1ab379 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057865 Oct 20 14:44:54.767904 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 266/525] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:44:55.041801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:55.054908 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7513fa0f-2fea-447e-b37b-ca93be1acf05 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1641 microversion: 2.1 time: 0.377663 Oct 20 14:44:55.073953 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 260/526] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:44:54 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1641 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:44:55.628628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:55.629319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:55.635829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:55.636305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:55.636770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:55.637454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:55.638429 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:55.638903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:55.706707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:55.718880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:55.720532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:55.722044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8b70ca5b-e426-43f5-be59-ef339ff13ab6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1657 microversion: 2.20 time: 0.098381 Oct 20 14:44:55.722921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 267/527] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:44:55 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1657 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:44:56.020059 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-42fe6dbf-a384-4f62-8a30-eeacae491333 req-2acaa0da-a0b6-4fee-966a-55fded5c2fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8a24968-9e6f-4fd7-9942-87adf39c1cc0", "name": "network-vif-deleted", "tag": "a22f57d8-7ba2-4e40-a3c8-816edda0fade"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:56.031725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-42fe6dbf-a384-4f62-8a30-eeacae491333 req-2acaa0da-a0b6-4fee-966a-55fded5c2fb1 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:56.032491 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-42fe6dbf-a384-4f62-8a30-eeacae491333 req-2acaa0da-a0b6-4fee-966a-55fded5c2fb1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:56.033101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-42fe6dbf-a384-4f62-8a30-eeacae491333 req-2acaa0da-a0b6-4fee-966a-55fded5c2fb1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:56.054189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-42fe6dbf-a384-4f62-8a30-eeacae491333 req-2acaa0da-a0b6-4fee-966a-55fded5c2fb1 service nova] Creating event network-vif-deleted:a22f57d8-7ba2-4e40-a3c8-816edda0fade for instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 on hv-cinder-77923 Oct 20 14:44:56.061542 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-42fe6dbf-a384-4f62-8a30-eeacae491333 req-2acaa0da-a0b6-4fee-966a-55fded5c2fb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045206 Oct 20 14:44:56.062420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 261/528] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:56.748682 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:56.749393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:56.756178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:56.756759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:56.757336 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:56.758143 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:56.758660 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:56.759149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:56.792127 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:56.792810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:56.793402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:56.793855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lazy-loading 'fault' on Instance uuid a8a24968-9e6f-4fd7-9942-87adf39c1cc0 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:44:56.802462 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-f09bb18a-1a7f-47a6-a3fc-07c90a2e51a7 req-7baa6204-7df8-41f8-a8e3-6cb392fdadb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7254508-d290-4971-a856-7c9afb57161b", "tag": "813487db-4806-4570-a1f7-f8c76f352e9e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:56.817032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f09bb18a-1a7f-47a6-a3fc-07c90a2e51a7 req-7baa6204-7df8-41f8-a8e3-6cb392fdadb2 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:56.818866 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f09bb18a-1a7f-47a6-a3fc-07c90a2e51a7 req-7baa6204-7df8-41f8-a8e3-6cb392fdadb2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:56.819330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-f09bb18a-1a7f-47a6-a3fc-07c90a2e51a7 req-7baa6204-7df8-41f8-a8e3-6cb392fdadb2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:56.833382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-f09bb18a-1a7f-47a6-a3fc-07c90a2e51a7 req-7baa6204-7df8-41f8-a8e3-6cb392fdadb2 service nova] Creating event network-changed:813487db-4806-4570-a1f7-f8c76f352e9e for instance c7254508-d290-4971-a856-7c9afb57161b on hv-cinder-77923 Oct 20 14:44:56.848527 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:56.851316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-f09bb18a-1a7f-47a6-a3fc-07c90a2e51a7 req-7baa6204-7df8-41f8-a8e3-6cb392fdadb2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053311 Oct 20 14:44:56.852022 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 262/529] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:44:56.860694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:56.862200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:44:56.863483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-779bf289-1016-48d2-aab3-0b346265567c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 200 len: 1372 microversion: 2.20 time: 0.118782 Oct 20 14:44:56.868387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 268/530] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:44:56 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 1372 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:44:57.890863 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:57.891548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:44:57.898095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:57.898571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:57.899013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:57.899680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:44:57.900123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:44:57.900580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:44:57.914178 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] HTTP exception thrown: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Request method failure captured: Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 HTTP/1.1 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4BBNwHeZvbdouXQ76-JomKKYMkXuNrzeqqn_egIpEbJUXeEOZ2zrl61HoNIDmvs3DcYumCw61_6G5sEhAm3KOdItJymvZllUbFe_t8-Ww53X0gaGLPS_y-sn-EgNt8F4uPec8pexBW8MeXQBF9yx7A5CZ8nzQgIk9n1VElARrKEWw Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:44:57.915764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 9fc72f6965bb4814a5d85bd04769e4cb Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:44:57.917393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'a8a24968-9e6f-4fd7-9942-87adf39c1cc0'} Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:44:57.918267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:44:57.920307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:44:57.922017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Returning 404 to user: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:44:57.922017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8fbf816c-f7ec-4dec-9465-bad571a2343c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 404 len: 111 microversion: 2.20 time: 0.030963 Oct 20 14:44:57.922017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 263/531] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:44:57 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:44:57.926410 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-46021fdb-e339-4829-9f80-a228d9f6142b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '.version_select at 0x7f6344f83d30>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:44:57.950592 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-46021fdb-e339-4829-9f80-a228d9f6142b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703811471" status: 204 len: 0 microversion: 2.20 time: 0.027826 Oct 20 14:44:57.951193 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 269/532] 10.222.0.13 () {60 vars in 1262 bytes} [Thu Oct 20 14:44:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1703811471 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Oct 20 14:44:58.570110 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-37e616cb-d06d-45f1-b9a6-c41683d0f087 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'create', calling method: .version_select at 0x7f6344e67a60>, body: {"keypair": {"name": "tempest-keypair-1900109462", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKTRHawmR+8iTZQ8kzbsm1m6GFFP7lUxZch+ieCW0+CpV/nBI6lumSw3o3l+gUN2XfHYQwm7DBe48hO/2yN+lJdsUtrwsZ/DZPAo33ZP818MqAwQxkVrvsj7KIqFbMynDg=="}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:58.585529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-37e616cb-d06d-45f1-b9a6-c41683d0f087 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for project afd56c15beff4515a44799ee7ec083a3. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:44:58.589343 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-37e616cb-d06d-45f1-b9a6-c41683d0f087 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for user 9fc72f6965bb4814a5d85bd04769e4cb and project afd56c15beff4515a44799ee7ec083a3. Resources: {'key_pairs'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:44:58.613890 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-37e616cb-d06d-45f1-b9a6-c41683d0f087 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047827 Oct 20 14:44:58.614496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 264/533] 10.222.0.13 () {62 vars in 1200 bytes} [Thu Oct 20 14:44:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 20 14:44:59.877953 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1917788311", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8527c204-ec5a-42a2-811a-426241f609de"}], "security_groups": [{"name": "tempest-securitygroup--516929481"}], "key_name": "tempest-keypair-1900109462", "user_data": "}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:44:59.978959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] validate_networks() for [('8527c204-ec5a-42a2-811a-426241f609de', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:45:00.356100 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:45:00.357573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:45:00.358048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:45:00.358459 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:45:00.358872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:45:00.367794 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:00.368274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:00.368779 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:00.369539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:00.369993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:00.370445 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:00.387364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for project afd56c15beff4515a44799ee7ec083a3. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:45:00.391334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Getting quotas for user 9fc72f6965bb4814a5d85bd04769e4cb and project afd56c15beff4515a44799ee7ec083a3. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:45:00.402297 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:45:00.405151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:45:00.451026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-090d533e-1d9e-4b5d-8fc1-4c8c433c3ea0 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.577728 Oct 20 14:45:00.458034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 270/534] 10.222.0.13 () {62 vars in 1188 bytes} [Thu Oct 20 14:44:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 586 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 20 14:45:00.463025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-454d0759-71b2-4113-b4d6-e134ab48d85f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:00.463641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-454d0759-71b2-4113-b4d6-e134ab48d85f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:00.519999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-454d0759-71b2-4113-b4d6-e134ab48d85f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:00.527214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-454d0759-71b2-4113-b4d6-e134ab48d85f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:00.530161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-454d0759-71b2-4113-b4d6-e134ab48d85f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:00.531097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-454d0759-71b2-4113-b4d6-e134ab48d85f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1282 microversion: 2.20 time: 0.071882 Oct 20 14:45:00.531663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 265/535] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:00 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:45:01.556954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:01.557492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:01.563578 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:01.564320 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:01.564768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:01.565450 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:01.565904 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:01.566307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:01.628060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:01.636948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:01.638566 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:01.640747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bb42a4ea-8ebd-4d06-aec2-a56f890ec8aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1334 microversion: 2.20 time: 0.088326 Oct 20 14:45:01.641519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 271/536] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:01 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:02.667277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:02.667869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:02.675475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:02.676081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:02.676548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:02.677249 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:02.677698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:02.678116 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:02.746269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:02.755220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:02.756917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:02.758071 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ff55840f-e9df-4f80-b7b8-d41dd4aebefb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1340 microversion: 2.20 time: 0.094701 Oct 20 14:45:02.758632 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 266/537] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:02 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1340 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:45:03.785066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:03.785666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:03.791833 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:03.792315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:03.792772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:03.793461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:03.793909 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:03.794323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:03.850776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a05adccd-6a2b-40d7-80ee-e5bd6d084c8d req-440df544-8660-4873-851e-1f2bc55adb71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:03.870039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a05adccd-6a2b-40d7-80ee-e5bd6d084c8d req-440df544-8660-4873-851e-1f2bc55adb71 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:03.870904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a05adccd-6a2b-40d7-80ee-e5bd6d084c8d req-440df544-8660-4873-851e-1f2bc55adb71 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:03.871560 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a05adccd-6a2b-40d7-80ee-e5bd6d084c8d req-440df544-8660-4873-851e-1f2bc55adb71 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:03.888670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a05adccd-6a2b-40d7-80ee-e5bd6d084c8d req-440df544-8660-4873-851e-1f2bc55adb71 service nova] Creating event network-changed:20cf55bd-3d91-4bda-9c08-8252ca71c6a7 for instance 51cb557d-d0f7-4b32-bc95-04812c917244 on hv-cinder-77923 Oct 20 14:45:03.894319 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a05adccd-6a2b-40d7-80ee-e5bd6d084c8d req-440df544-8660-4873-851e-1f2bc55adb71 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048885 Oct 20 14:45:03.895213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 267/538] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:45:03.935930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:03.944370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:03.945780 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:03.946875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7e42338b-0f6b-4f05-a429-a1736661ed8b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1407 microversion: 2.20 time: 0.166598 Oct 20 14:45:03.947430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 272/539] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:03 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:04.974637 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:04.975337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:04.981471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:04.981948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:04.982643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:04.983326 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:04.984910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:04.985343 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:05.113719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:05.121644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:05.123069 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:05.124160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7a65e9f0-3dec-45eb-b423-7bfb24ac2fca tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1407 microversion: 2.20 time: 0.154297 Oct 20 14:45:05.124950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 268/540] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:04 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:06.150482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:06.151172 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:06.157434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:06.157910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:06.158340 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:06.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:06.159479 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:06.159893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:06.292291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:06.301520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:06.302975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:06.304088 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f2695b6b-8b29-4ccf-aeb1-053a90189e73 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1407 microversion: 2.20 time: 0.157451 Oct 20 14:45:06.304704 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 273/541] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:06 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:07.329649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:07.330165 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:07.332560 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=97,nova_api:DELETE=1,nova_api:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:07.338069 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:07.338546 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:07.338978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:07.339672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:07.340115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:07.340558 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:07.472116 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:07.480123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:07.481595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:07.482966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5f676611-3169-453a-ab43-7eddeb30e597 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1407 microversion: 2.20 time: 0.157564 Oct 20 14:45:07.483530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 269/542] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:07 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:08.224083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-3f113359-5735-40e3-b2c0-b481df5fa044 req-5a2289bd-7c43-48a4-9eae-84154b5d0936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "name": "network-vif-plugged", "status": "completed", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:08.234317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-3f113359-5735-40e3-b2c0-b481df5fa044 req-5a2289bd-7c43-48a4-9eae-84154b5d0936 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:08.235337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-3f113359-5735-40e3-b2c0-b481df5fa044 req-5a2289bd-7c43-48a4-9eae-84154b5d0936 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:08.235871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-3f113359-5735-40e3-b2c0-b481df5fa044 req-5a2289bd-7c43-48a4-9eae-84154b5d0936 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:08.249262 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-3f113359-5735-40e3-b2c0-b481df5fa044 req-5a2289bd-7c43-48a4-9eae-84154b5d0936 service nova] Creating event network-vif-plugged:20cf55bd-3d91-4bda-9c08-8252ca71c6a7 for instance 51cb557d-d0f7-4b32-bc95-04812c917244 on hv-cinder-77923 Oct 20 14:45:08.254788 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-3f113359-5735-40e3-b2c0-b481df5fa044 req-5a2289bd-7c43-48a4-9eae-84154b5d0936 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034389 Oct 20 14:45:08.255369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 274/543] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:08.509017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:08.509630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:08.515932 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:08.516450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:08.516887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:08.517606 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:08.518057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:08.518475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:08.646352 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:08.655054 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:08.657431 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:08.658568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5c901fd2-aad4-4ca6-8945-501a1b3acb5e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1407 microversion: 2.20 time: 0.153518 Oct 20 14:45:08.659133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 270/544] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:08 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:09.685831 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:09.686413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:09.693017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:09.693494 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:09.693924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:09.694605 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:09.695057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:09.695475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:09.826891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:09.835887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:09.837522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:09.838625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fb9b8399-b236-4eee-90a1-24bb6512918d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1407 microversion: 2.20 time: 0.157669 Oct 20 14:45:09.839171 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 275/545] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:09 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:10.863886 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:10.864589 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:10.866846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:10.872122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:10.872630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:10.873059 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:10.873949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:10.874405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:10.874822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:11.000948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:11.008824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:11.010242 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:11.011375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-78a22568-b621-42a6-ab6b-8d01b043f411 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1600 microversion: 2.20 time: 0.151480 Oct 20 14:45:11.011934 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 271/546] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:45:10 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:45:11.036544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:11.037035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:11.038928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:11.039585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:11.046290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:11.046773 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:11.047719 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:11.048596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:11.049059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:11.049531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:11.128588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-75b12353-b650-4099-883b-97685d0baa6c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095970 Oct 20 14:45:11.129192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 276/547] 10.222.0.13 () {60 vars in 1316 bytes} [Thu Oct 20 14:45:11 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:45:12.055428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-cb96e372-f718-4de1-a00a-b6f6d969c2b8 req-e260116d-cd6e-4007-b751-d2119f98982e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:12.068985 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cb96e372-f718-4de1-a00a-b6f6d969c2b8 req-e260116d-cd6e-4007-b751-d2119f98982e service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:12.069764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cb96e372-f718-4de1-a00a-b6f6d969c2b8 req-e260116d-cd6e-4007-b751-d2119f98982e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:12.070366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cb96e372-f718-4de1-a00a-b6f6d969c2b8 req-e260116d-cd6e-4007-b751-d2119f98982e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:12.082246 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-cb96e372-f718-4de1-a00a-b6f6d969c2b8 req-e260116d-cd6e-4007-b751-d2119f98982e service nova] Creating event network-changed:20cf55bd-3d91-4bda-9c08-8252ca71c6a7 for instance 51cb557d-d0f7-4b32-bc95-04812c917244 on hv-cinder-77923 Oct 20 14:45:12.087674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-cb96e372-f718-4de1-a00a-b6f6d969c2b8 req-e260116d-cd6e-4007-b751-d2119f98982e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035957 Oct 20 14:45:12.088278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 272/548] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:27.375939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:27.376804 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=46 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:27.381243 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:27.383462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:27.390696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:27.391180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:27.391618 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:27.392307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:27.392944 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:27.393371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:27.466105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5a0cffc6-3200-4027-9933-ab6c6a209c9b tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/action" status: 202 len: 0 microversion: 2.1 time: 0.091339 Oct 20 14:45:27.466836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 277/549] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:45:27 2022] POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:45:27.474336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=7 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:27.475272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=82 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:27.481875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:27.482738 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:27.493878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:27.494409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:27.494879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:27.495638 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:27.496130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:27.496624 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:27.649851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:27.658536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-88caa53a-a324-4438-ba43-25ee8398d78c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1752 microversion: 2.1 time: 0.186772 Oct 20 14:45:27.659174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 273/550] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:27 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1752 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:28.683348 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:28.683963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:28.690830 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:28.691306 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:28.691741 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:28.692564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:28.693021 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:28.693446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:28.832857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:28.841074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cde8f7ba-c1f7-486d-95e2-a552028dc3c6 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.162497 Oct 20 14:45:28.841646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 278/551] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:28 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:29.865506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:29.866205 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:29.872581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:29.873084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:29.873536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:29.874209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:29.875431 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:29.875793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:29.932858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e4c84491-d7db-47b0-8b1b-dd6351f54af3"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:29.935270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:29.942153 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:29.942628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:29.943049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:29.943729 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:29.944193 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:29.944639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:30.016447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:30.024709 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8a4b3f52-8e1d-442b-89f9-5a37c58a32e5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.162917 Oct 20 14:45:30.025283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 274/552] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:29 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:30.184399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fdc33311-dcc7-4276-9a7b-cdbf68bbfb4b tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255518 Oct 20 14:45:30.185073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 279/553] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:45:29 2022] POST /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:45:31.048780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:31.049390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:31.056316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:31.056816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:31.057247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:31.057933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:31.058381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:31.058800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:31.429924 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:31.438936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-24d1ab7a-5716-4443-8c21-c77720866947 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.394751 Oct 20 14:45:31.439511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 275/554] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:31 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:32.463017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:32.463708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:32.470385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:32.470859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:32.471287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:32.471967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:32.472440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:32.472859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:32.614580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:32.622797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5bc4f931-385e-4bef-97c1-9515c9fb9831 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.164467 Oct 20 14:45:32.623373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 280/555] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:32 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:33.646679 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:33.647212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:33.653560 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:33.654041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:33.654471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:33.655150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:33.655593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:33.656057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:33.793065 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:33.801707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ba892ce4-765a-4b2e-acf0-672e257f03c7 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.159008 Oct 20 14:45:33.802283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 276/556] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:33 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:34.825165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:34.825776 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:34.832809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:34.833286 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:34.833714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:34.834393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:34.834836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:34.835251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:34.975483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:34.985212 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c2cc27c7-e29a-4928-b9da-83068c2df26e tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.163838 Oct 20 14:45:34.985808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 281/557] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:34 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:36.007509 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:36.008118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:36.015626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:36.016155 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:36.016609 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:36.017288 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:36.017734 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:36.018152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:36.161963 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:36.170191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f6dc6266-dad8-42d2-ab54-2dd7481c5a22 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.166607 Oct 20 14:45:36.170759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 277/558] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:36 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:37.193857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:37.194461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:37.200818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:37.201299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:37.201733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:37.203118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:37.203574 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:37.203995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:37.342569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:37.350855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d7368570-524a-40e1-a8b4-c0c5768b9992 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.160853 Oct 20 14:45:37.351436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 282/559] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:37 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:37.723256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:37.725554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:37.732152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:37.732666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:37.733092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:37.734114 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:37.734290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:37.734707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:37.757478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lazy-loading 'flavor' on Instance uuid 824af68b-a192-4a4d-8058-1ab7086ef986 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:45:37.878720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6ebad35c-73ad-4ea9-9ebd-fe9d0e65f88a tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/action" status: 200 len: 32 microversion: 2.1 time: 0.159226 Oct 20 14:45:37.879265 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 278/560] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:45:37 2022] POST /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/action => generated 32 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 14:45:37.889489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:37.891348 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:37.897539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:37.898030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:37.898468 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:37.899167 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:37.899733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:37.900198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:38.037520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:38.047531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f284094d-05f8-490c-8079-e19ce58fea84 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.162640 Oct 20 14:45:38.048122 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 283/561] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:37 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:38.376092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:38.376922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:38.383061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:38.383610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:38.384046 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:38.384776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:38.385248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:38.385666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:38.526176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:38.534950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9c82a90d-e7ce-45a1-9738-efe699675b93 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1757 microversion: 2.1 time: 0.163705 Oct 20 14:45:38.535526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 279/562] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:38 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:39.072409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:39.073018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:39.079645 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.080123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.080577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.081262 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.081709 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.082129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.211900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:39.220567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5e7368b7-4fdf-4f04-9e23-05aacd1bbb68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.152090 Oct 20 14:45:39.221136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 284/563] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:39 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:39.540552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:39.541126 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:39.548115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.548611 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.549041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.549725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.550173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.550590 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.557835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:39.558446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:39.564946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.565431 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.565863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.566560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.567015 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.567438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.576360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:45:39.660867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2d5b486a-ba28-4c4f-a3ba-828f80bf405e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 204 len: 0 microversion: 2.1 time: 0.123921 Oct 20 14:45:39.661953 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 280/564] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:45:39 2022] DELETE /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:45:39.670599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:39.671816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:39.677635 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.678125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.678565 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.679262 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:39.679717 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:39.680145 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:39.714908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:39.723343 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-deaeb79d-3708-4339-b087-53c76f21c230 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1760 microversion: 2.1 time: 0.169383 Oct 20 14:45:39.724131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 285/565] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:39 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1760 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:39.811425 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:39.819724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8533dc0c-99b4-445a-9d7f-2a1a5becb2d6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1575 microversion: 2.1 time: 0.153374 Oct 20 14:45:39.820298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 281/566] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:39 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:40.078954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:40.079508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:40.085851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.086331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.086766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.087453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.087913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.088334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.113523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d5ee94eb-9711-49fb-9011-c05d15799865 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/ips" status: 200 len: 150 microversion: 2.1 time: 0.038905 Oct 20 14:45:40.114083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 286/567] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:45:40 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:40.243452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:40.244067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:40.250400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.250868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.251300 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.251995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.252474 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.252900 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.401884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:40.411691 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-38e71c07-f386-482e-a1f4-114daf48e248 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.171992 Oct 20 14:45:40.412273 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 282/568] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:40 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:40.841813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:40.842982 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:40.843776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:40.844264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:40.850229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.850394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.850717 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.850843 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.851150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.851272 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.851844 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.851961 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.852295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.852442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.852745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.852849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.882837 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a3eb4ae2-16dd-4f8a-af4a-c2de574608c3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044821 Oct 20 14:45:40.883504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 287/569] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:45:40 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 14:45:40.947550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:40.948059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:40.954875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.955358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.955791 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.956528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:40.956985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:40.957410 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:40.982543 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:45:40.984960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:40.992626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-286f71a9-aac4-498b-8003-e999016bc18f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1575 microversion: 2.1 time: 0.153702 Oct 20 14:45:40.993189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 283/570] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:40 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:41.063350 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-57f55ef4-e70d-497c-b71f-ff6ff3a8411a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 204 len: 0 microversion: 2.1 time: 0.117969 Oct 20 14:45:41.063852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 288/571] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:45:40 2022] DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 14:45:41.071998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:41.072794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:41.078988 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:41.079469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:41.079902 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:41.080620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:41.081066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:41.081487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:41.210290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:41.218059 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6217ce90-8682-421a-803a-2144a089c602 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1673 microversion: 2.1 time: 0.149882 Oct 20 14:45:41.218633 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 284/572] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:41 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1673 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:41.436289 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:41.437312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:41.443683 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:41.444092 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:41.444750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:41.445293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:41.445742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:41.446188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:41.465031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73553714-a359-4c20-a454-607ddd56773d"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:41.467458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:41.474481 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:41.474970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:41.475406 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:41.476100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:41.476610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:41.477038 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:41.551274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:41.580595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:41.584228 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:41.589726 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9657735e-ea0d-42c8-9774-a0163b218722 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.157814 Oct 20 14:45:41.590297 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 289/573] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:41 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:42.017879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:42.018480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:42.025169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:42.025651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:42.026077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:42.026753 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:42.027202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:42.027617 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:42.164769 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:42.172521 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-12bc7f6b-1984-47f5-9c63-11293943f878 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1575 microversion: 2.1 time: 0.159751 Oct 20 14:45:42.173098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 290/574] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:42 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:42.241241 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:42.241849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:42.247533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:42.248016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:42.248567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:42.249910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:42.250444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:42.250874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:42.376884 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:42.384542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8a45b3eb-1235-4c00-83c8-bdef55bee6d2 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1673 microversion: 2.1 time: 0.146889 Oct 20 14:45:42.385116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 291/575] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:42 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:42.613774 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:42.614377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:42.620825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:42.621307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:42.621742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:42.622434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:42.622891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:42.623352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:42.750444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:42.758551 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-bc42ce08-e025-473d-bd61-35450a2d2968 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.148664 Oct 20 14:45:42.759121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 292/576] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:42 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:43.195958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:43.196603 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:43.203665 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:43.204150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:43.204615 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:43.205303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:43.205755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:43.206178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:43.355924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:43.366245 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-39277717-fba7-4beb-bb1f-83b436a946ea tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1575 microversion: 2.1 time: 0.174099 Oct 20 14:45:43.366825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 293/577] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:43 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:43.408421 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:43.409137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:43.415317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:43.415802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:43.416241 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:43.416970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:43.417572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:43.417998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:43.425910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6964b27b-5bf8-4ae6-9cb5-cc514e82881b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.964402 Oct 20 14:45:43.432090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 285/578] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:45:41 2022] POST /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments => generated 194 bytes in 1966 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:45:43.582111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:43.590574 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-36e5a49c-484c-4d97-beba-9e28a21458f3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1673 microversion: 2.1 time: 0.186999 Oct 20 14:45:43.591169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 294/579] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:43 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1673 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:43.784107 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:43.784950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:43.791318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:43.791797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:43.792229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:43.792948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:43.793400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:43.793814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:43.933252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:43.942920 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-33f55cab-d893-45a2-b3ca-c34ec6ab40d2 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.164268 Oct 20 14:45:43.943572 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 286/580] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:43 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:44.390887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:44.391523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:44.398916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:44.399523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:44.400083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:44.400912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:44.401391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:44.401900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:44.549500 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:44.560206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6879d8bb-1fd6-4e4f-9709-d07437e35b89 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1575 microversion: 2.1 time: 0.173517 Oct 20 14:45:44.560831 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 295/581] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:44 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:44.614767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:44.615347 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:44.621893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:44.622382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:44.622826 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:44.623529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:44.624522 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:44.624952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:44.687322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:44.695126 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-09ccb6b7-d3d0-480a-9e6d-38f2b4482417 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1606 microversion: 2.1 time: 0.084403 Oct 20 14:45:44.695701 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 287/582] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:44 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1606 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:44.968442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:44.969194 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:44.975641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:44.976507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:44.976748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:44.977656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:44.978461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:44.979045 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.080861 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-7bbed33b-cbbd-45fa-9ab4-f01cb0881e1c req-44bbd5a1-79b8-475a-9bd5-1b682bae8424 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0b82f520-a300-4205-9ff6-f31ec81518e0", "name": "network-vif-deleted", "tag": "3aeaede2-76c6-42b7-b8b7-f33a546e2f7d"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:45.146199 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7bbed33b-cbbd-45fa-9ab4-f01cb0881e1c req-44bbd5a1-79b8-475a-9bd5-1b682bae8424 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.146767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7bbed33b-cbbd-45fa-9ab4-f01cb0881e1c req-44bbd5a1-79b8-475a-9bd5-1b682bae8424 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.147275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7bbed33b-cbbd-45fa-9ab4-f01cb0881e1c req-44bbd5a1-79b8-475a-9bd5-1b682bae8424 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.179410 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-7bbed33b-cbbd-45fa-9ab4-f01cb0881e1c req-44bbd5a1-79b8-475a-9bd5-1b682bae8424 service nova] Creating event network-vif-deleted:3aeaede2-76c6-42b7-b8b7-f33a546e2f7d for instance 0b82f520-a300-4205-9ff6-f31ec81518e0 on hv-cinder-77923 Oct 20 14:45:45.185148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-7bbed33b-cbbd-45fa-9ab4-f01cb0881e1c req-44bbd5a1-79b8-475a-9bd5-1b682bae8424 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108611 Oct 20 14:45:45.187213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 288/583] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:45.262181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:45.275772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8b1c0ce4-c99e-4e2b-9991-13c4d3395c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.312370 Oct 20 14:45:45.276463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 296/584] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:44 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:45.586801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:45.586801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:45.593577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.594190 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.594511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.595254 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.595714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.596169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.630782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.631376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.631713 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.632156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lazy-loading 'fault' on Instance uuid 0b82f520-a300-4205-9ff6-f31ec81518e0 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:45:45.687326 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:45.695742 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4cf2fb76-5fb9-472b-b1af-b862d7eddf73 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 200 len: 1231 microversion: 2.1 time: 0.114179 Oct 20 14:45:45.696368 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 289/585] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:45 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:45.719533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:45.720226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:45.728533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.729232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.729677 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.730392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.730851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.731531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.766855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:45.767607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:45.768429 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:45.768584 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lazy-loading 'fault' on Instance uuid 38c72900-27b7-470e-9d95-752506e689ad {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:45:45.812385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:45.820211 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fde6054b-622f-454d-ae39-d7949bb23ee6 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 200 len: 1326 microversion: 2.1 time: 0.104997 Oct 20 14:45:45.821290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 297/586] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:45 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 1326 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:46.300580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:46.301411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:46.309485 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:46.310065 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:46.310579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:46.311462 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:46.311992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:46.312527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:46.463203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:46.471642 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-369ef937-22cc-40da-a412-e7cf31a76193 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.175131 Oct 20 14:45:46.472214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 290/587] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:46 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:46.719869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:46.720629 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:46.726911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:46.727395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:46.727836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:46.728640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:46.729097 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:46.729521 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:46.743468 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] HTTP exception thrown: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Request method failure captured: Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 HTTP/1.1 Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV5NO4FiehDVR025vDvFrQ37MIgZvJUKolQ2_09_kM7uzeb9ff6iSDMbTwqA3twz9LNVFERar8cb9FSWhQuYLImzoEDB6GfC8xVt-xpzU-az0WK1QPsaioNVcd2DnABJFwB8SftMgfEHSn3GFngGmionfIizuooGnZbbKamFLN8wZ3w Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:45:46.745123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-TestVolumeBootPattern-563455495 Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: ac5921418d40446c80892b04a3eee12d Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:45:46.746705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '0b82f520-a300-4205-9ff6-f31ec81518e0'} Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:45:46.747586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:45:46.749076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.750319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Returning 404 to user: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:45:46.750319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e287b7df-d68a-42cf-811f-9fe7aee8d38e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 404 len: 111 microversion: 2.1 time: 0.031124 Oct 20 14:45:46.750319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 298/588] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:46 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:45:46.841741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-804930152", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1163109215", "security_groups": [{"name": "tempest-secgroup-smoke-41998486"}], "block_device_mapping_v2": [{"uuid": "328acbde-11a4-495e-99cf-14b398ab5c27", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c924697c-b180-4b1b-9f12-d7889a054b97"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:46.845142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:46.845747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:46.851703 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:46.852170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:46.852635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:46.853317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:46.853763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:46.854179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:46.870188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] HTTP exception thrown: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Request method failure captured: Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad HTTP/1.1 Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4D5gcewTkwFK0OyedwlqBwK-qNHv86mErNiaHt5_8qXpz7WhVIHxQ0PzgyQoYzWPAPy42CX7tRLOvezIk9i1kdX2ivIdLQHvLoOU4lbatOipUJC4L6_GejtQtvNkAN9qZ_FrUhI8e5yKowf-cfgpUdWeMiWdxuAO5qjzj-6zBE9lI Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:45:46.871697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 4d74d7fd62cd464183f9df4ca581833c Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:45:46.873066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '38c72900-27b7-470e-9d95-752506e689ad'} Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:45:46.873871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:45:46.875200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:46.876550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Returning 404 to user: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:45:46.876550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-18b2b369-6854-4bc7-8a11-6fc771d4dc29 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 404 len: 111 microversion: 2.1 time: 0.032296 Oct 20 14:45:46.877108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 299/589] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:46 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 14:45:46.881577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fce3d103-fe4e-4af2-af9e-49a77402b6b4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '.version_select at 0x7f6344efe9d0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:46.900192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fce3d103-fe4e-4af2-af9e-49a77402b6b4 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-499372789" status: 202 len: 0 microversion: 2.1 time: 0.022064 Oct 20 14:45:46.900786 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 300/590] 10.222.0.13 () {58 vars in 1218 bytes} [Thu Oct 20 14:45:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-499372789 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:45:46.986184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] validate_networks() for [('c924697c-b180-4b1b-9f12-d7889a054b97', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:45:47.201843 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-e5f45d12-5893-40a0-ab38-242d991915a0 req-bebda99f-b52c-4d92-91b1-6b5a7fec0892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c72900-27b7-470e-9d95-752506e689ad", "name": "network-vif-deleted", "tag": "113928f5-c90e-4f91-8207-0c0a6f2d414b"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:47.214689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-e5f45d12-5893-40a0-ab38-242d991915a0 req-bebda99f-b52c-4d92-91b1-6b5a7fec0892 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:47.214689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-e5f45d12-5893-40a0-ab38-242d991915a0 req-bebda99f-b52c-4d92-91b1-6b5a7fec0892 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:47.215167 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-e5f45d12-5893-40a0-ab38-242d991915a0 req-bebda99f-b52c-4d92-91b1-6b5a7fec0892 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:47.229481 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-e5f45d12-5893-40a0-ab38-242d991915a0 req-bebda99f-b52c-4d92-91b1-6b5a7fec0892 service nova] Creating event network-vif-deleted:113928f5-c90e-4f91-8207-0c0a6f2d414b for instance 38c72900-27b7-470e-9d95-752506e689ad on hv-cinder-77923 Oct 20 14:45:47.236261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-e5f45d12-5893-40a0-ab38-242d991915a0 req-bebda99f-b52c-4d92-91b1-6b5a7fec0892 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038412 Oct 20 14:45:47.237399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 301/591] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:47.432851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:45:47.433415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:45:47.433919 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:45:47.434334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:45:47.434740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:45:47.444168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:47.444691 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:47.445122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:47.445841 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:47.446292 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:47.446711 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:47.463790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for project d5614088125349f1975cc55b25dd9dbc. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:45:47.468030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for user ac5921418d40446c80892b04a3eee12d and project d5614088125349f1975cc55b25dd9dbc. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:45:47.497219 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:47.498181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:47.508896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:47.509694 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:47.510216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:47.511036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:47.511499 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:47.511923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:47.535721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:45:47.538113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='328acbde-11a4-495e-99cf-14b398ab5c27',volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:45:47.665123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:47.678567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3a342586-e0d4-4074-bf19-1449cb43effb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.186698 Oct 20 14:45:47.679325 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 302/592] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:47 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:47.695927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9050393b-2cfa-48de-961d-90471b8b7acc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: .version_select at 0x7f6344e0c4c0>, body: {"keypair": {"name": "tempest-keypair-90918464", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC/EqfkxCBAm8i8+Q5hrkVI30sl/HG0iG2MwKFU760D4Ge1pAGiIHiecPMx+m0B7k5lKduI+aa3BL1OXwPB+hBkQun6CiPikzY5VX/b3qDnBs/sxogXU6XxmVP0kqGJ8Pw=="}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:47.707275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [6e2fccda-2014-4cfc-9cf3-9d41b0441b80] AMQP server on 10.222.0.13:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Oct 20 14:45:47.711356 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-9050393b-2cfa-48de-961d-90471b8b7acc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for project a3d7fadfead1456792446f71c465bc0c. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:45:47.715096 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-9050393b-2cfa-48de-961d-90471b8b7acc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for user 4d74d7fd62cd464183f9df4ca581833c and project a3d7fadfead1456792446f71c465bc0c. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:45:47.738424 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9050393b-2cfa-48de-961d-90471b8b7acc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.046715 Oct 20 14:45:47.740460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 303/593] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:45:47 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:48.704612 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:48.705341 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:48.712010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:48.712542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:48.713089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:48.713780 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:48.714238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:48.714661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:48.715122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [6e2fccda-2014-4cfc-9cf3-9d41b0441b80] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 34488. Oct 20 14:45:48.720097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a03f206e-f46b-412a-8898-ba97d36c2513 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.882262 Oct 20 14:45:48.721519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 291/594] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:45:46 2022] POST /compute/v2.1/servers => generated 404 bytes in 1884 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:45:48.751184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6d07885a-63f5-4507-b182-16f4af94b140 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:48.753499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6d07885a-63f5-4507-b182-16f4af94b140 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:48.844937 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6d07885a-63f5-4507-b182-16f4af94b140 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:48.855717 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6d07885a-63f5-4507-b182-16f4af94b140 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1094 microversion: 2.1 time: 0.123223 Oct 20 14:45:48.857849 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 292/595] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:48 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:48.906025 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:48.914510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3355a57b-1297-4a59-8595-5069e1242aa9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.214684 Oct 20 14:45:48.915086 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 304/596] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:48 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:49.092324 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-771452303", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc293b8c-746d-49c9-a6cf-e8d38b9a4352"}], "security_groups": [{"name": "tempest-securitygroup--1999943"}], "key_name": "tempest-keypair-90918464", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:49.196004 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] validate_networks() for [('fc293b8c-746d-49c9-a6cf-e8d38b9a4352', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:45:49.555888 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:45:49.556304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:45:49.556809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:45:49.557210 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:45:49.557612 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:45:49.566331 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:49.566806 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:49.567233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:49.567949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:49.568419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:49.568847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:49.586000 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for project a3d7fadfead1456792446f71c465bc0c. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:45:49.590361 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Getting quotas for user 4d74d7fd62cd464183f9df4ca581833c and project a3d7fadfead1456792446f71c465bc0c. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:45:49.603518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:45:49.606006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:45:49.652155 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3ec53514-f5eb-4c83-869f-5f762c60ab95 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.563982 Oct 20 14:45:49.652867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 293/597] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:45:49 2022] POST /compute/v2.1/servers => generated 399 bytes in 565 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:45:49.664504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8880f47b-96ce-4c78-9f43-c50135968696 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:49.665275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8880f47b-96ce-4c78-9f43-c50135968696 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:49.830432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8880f47b-96ce-4c78-9f43-c50135968696 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:49.837220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8880f47b-96ce-4c78-9f43-c50135968696 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1235 microversion: 2.1 time: 0.176586 Oct 20 14:45:49.837796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 305/598] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:49 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1235 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:49.882184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:49.884699 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:49.892128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:49.892646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:49.893900 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:49.901799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:49.906921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:49.907386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:49.940169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:49.941770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:49.948507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:49.949013 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:49.949660 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:49.950735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:49.951261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:49.951737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:49.979681 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:49.988809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-196e7278-b532-4f81-930e-6ada694d3745 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1144 microversion: 2.1 time: 0.110797 Oct 20 14:45:49.989392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 294/599] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:49 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1144 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:50.093507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:50.101747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ea508748-07f6-40e7-a973-01a3e81da370 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.166685 Oct 20 14:45:50.102314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 306/600] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:49 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:50.862111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:50.862720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:50.869143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:50.869624 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:50.870063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:50.870743 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:50.871362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:50.871793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:50.940109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:50.948733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5fe53fdc-584a-45eb-8d18-91c50ee510e9 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1231 microversion: 2.1 time: 0.091190 Oct 20 14:45:50.949319 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 295/601] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:50 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:51.011347 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:51.011978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:51.020999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:51.022126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:51.022879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:51.024144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:51.024999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:51.025774 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:51.097360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:51.105112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-348f38b4-8bbf-4714-bd59-c3cbe150965b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1192 microversion: 2.1 time: 0.097782 Oct 20 14:45:51.105677 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 307/602] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:51 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1192 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:51.125521 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:51.126055 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:51.132032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:51.132553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:51.132986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:51.133664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:51.134112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:51.134532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:51.311887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:51.319968 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1c303bc4-1ee9-49de-9aec-f11a72cb9c34 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1737 microversion: 2.1 time: 0.198589 Oct 20 14:45:51.320571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 296/603] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:51 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:51.973232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:51.973896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:51.979754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:51.980471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:51.980935 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:51.981883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:51.982331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:51.982750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.045531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:52.053945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-dc0b2015-8e2d-40c6-8c5e-7ebcfbd087fb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1231 microversion: 2.1 time: 0.084491 Oct 20 14:45:52.054678 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 308/604] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:51 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1231 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:52.129349 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:52.130039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.133658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "73553714-a359-4c20-a454-607ddd56773d"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:52.136071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.136748 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.137303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.137809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.138587 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.139118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.139602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.142169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.142613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.143042 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.143726 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.144170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.144621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.201782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:52.209943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e95572cf-207d-4437-a9ae-4d6a1ed6991a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1200 microversion: 2.1 time: 0.084445 Oct 20 14:45:52.210514 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 297/605] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:52 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:52.224437 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Invalid volume: volume 73553714-a359-4c20-a454-607ddd56773d is already attached to instances: c7254508-d290-4971-a856-7c9afb57161b Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: POST /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments HTTP/1.1 Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 74 Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:45:52.226109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {"volumeAttachment": {"volumeId": "73553714-a359-4c20-a454-607ddd56773d"}} Oct 20 14:45:52.227636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Invalid volume: volume 73553714-a359-4c20-a454-607ddd56773d is already attached to instances: c7254508-d290-4971-a856-7c9afb57161b Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'server_id': 'c7254508-d290-4971-a856-7c9afb57161b', 'body': {'volumeAttachment': {'volumeId': '73553714-a359-4c20-a454-607ddd56773d'}}} Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 73553714-a359-4c20-a454-607ddd56773d is already attached to instances: c7254508-d290-4971-a856-7c9afb57161b Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.228572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 73553714-a359-4c20-a454-607ddd56773d is already attached to instances: c7254508-d290-4971-a856-7c9afb57161b Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:52.229702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 73553714-a359-4c20-a454-607ddd56773d is already attached to instances: c7254508-d290-4971-a856-7c9afb57161b Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 400 to user: Invalid volume: volume 73553714-a359-4c20-a454-607ddd56773d is already attached to instances: c7254508-d290-4971-a856-7c9afb57161b {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6f3ce9b6-6e8c-4ae3-8bbc-2c2ed89d613e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097918 Oct 20 14:45:52.230848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 309/606] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:45:52 2022] POST /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 20 14:45:52.291375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:52.291865 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.298217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.298690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.299118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.299800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.300247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.300695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.342698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:52.343402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.350198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.350688 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.351114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.351818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.352251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.352695 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.383608 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'services' on Instance uuid c7254508-d290-4971-a856-7c9afb57161b {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:45:52.463155 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cd700ffd-5f9a-4159-b255-2f584575f7ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments/73553714-a359-4c20-a454-607ddd56773d" status: 202 len: 0 microversion: 2.1 time: 0.175325 Oct 20 14:45:52.466994 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 298/607] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:45:52 2022] DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments/73553714-a359-4c20-a454-607ddd56773d => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:45:52.475685 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:52.489598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.497343 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.497830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.500511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.502509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:52.503246 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.505270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.505677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.517662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f064e65b-3101-42c0-8a10-d7f84dd1beee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1717 microversion: 2.1 time: 0.176109 Oct 20 14:45:52.518943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 310/608] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:52 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1717 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:52.555702 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-813c7ff6-d223-422d-b8e6-42a670755cbc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085457 Oct 20 14:45:52.556519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 299/609] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:45:52 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments => generated 197 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:52.610764 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:52.611225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.617528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.618294 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.619243 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.620000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.620562 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.621050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.679722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:52.798634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] HTTP exception thrown: Cannot 'detach_volume' instance 824af68b-a192-4a4d-8058-1ab7086ef986 while it is in vm_state rescued Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Request method failure captured: Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments/e4c84491-d7db-47b0-8b1b-dd6351f54af3 HTTP/1.1 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV5TjoJLYhDXw1bj-3kscJgEH0wdlXR8gFBrluD-CiLj182QNmPe2U_X6kVdriE3DOCvvlh9PfylUAUezoqa8Gwnw10EGesOKq8iAZxHLj9EqZ9Io1PzTPzKIHMKpeC9DtPEU2wJxlLlfTGKNaWH_AR0ABT8P-fZ1C7uZWTH3U-jxg0 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:45:52.800658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: ae94a3ece5f644c6893589a1df84d1c6 Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:45:52.801874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Cannot 'detach_volume' instance 824af68b-a192-4a4d-8058-1ab7086ef986 while it is in vm_state rescued Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'server_id': '824af68b-a192-4a4d-8058-1ab7086ef986', 'id': 'e4c84491-d7db-47b0-8b1b-dd6351f54af3'} Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:45:52.802519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 824af68b-a192-4a4d-8058-1ab7086ef986 while it is in vm_state rescued Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 824af68b-a192-4a4d-8058-1ab7086ef986 while it is in vm_state rescued Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:45:52.803636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Returning 409 to user: Cannot 'detach_volume' instance 824af68b-a192-4a4d-8058-1ab7086ef986 while it is in vm_state rescued {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:45:52.804593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-740628da-9c9d-49aa-b677-495f81adc46f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments/e4c84491-d7db-47b0-8b1b-dd6351f54af3" status: 409 len: 152 microversion: 2.1 time: 0.196517 Oct 20 14:45:52.804593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 311/610] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:45:52 2022] DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments/e4c84491-d7db-47b0-8b1b-dd6351f54af3 => generated 152 bytes in 198 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 20 14:45:52.811419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:52.811983 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.817901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.818385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.818815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.819505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.819947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.820596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.891508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-174458d9-0268-49b8-8474-9170e08bc637 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "POST /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/action" status: 202 len: 0 microversion: 2.1 time: 0.083970 Oct 20 14:45:52.892713 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 300/611] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:45:52 2022] POST /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:45:52.901655 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:52.902266 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:52.908257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.908887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.909763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:52.910467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:52.910928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:52.911355 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.045992 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:53.056996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-89256a0d-4901-4c7c-8e46-aae06124d3ee tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1725 microversion: 2.1 time: 0.159536 Oct 20 14:45:53.060389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 312/612] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:52 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:53.077990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:53.078695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:53.081875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:53.085965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:53.086617 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:53.087059 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.087764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:53.088288 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:53.088749 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.185829 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:53.195380 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9ef042aa-9c2a-40ac-9002-4acd18936133 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1287 microversion: 2.1 time: 0.121419 Oct 20 14:45:53.195986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 301/613] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:53 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1287 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:53.233467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:53.234587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:53.242051 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:53.242733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:53.243467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.244318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:53.245033 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:53.245683 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.461170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:53.469066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b122cbe6-aa85-43f2-9c59-abe1d1b8906d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1276 microversion: 2.1 time: 0.239767 Oct 20 14:45:53.469638 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 313/614] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:53 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1276 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:53.568307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:53.570633 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:53.576606 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:53.577098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:53.578071 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.578782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:53.579235 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:53.579658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:53.600156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:53.613176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-92accdd0-0111-473b-a22c-7f06652bc4b8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048871 Oct 20 14:45:53.613761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 302/615] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:45:53 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:54.082585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:54.083261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:54.089988 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.090743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.091388 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.092291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.092948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.094732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.221387 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:54.222741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:54.230018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.230822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.231504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.232578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.233271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.234320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.293563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:54.303321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-003ade10-d899-4aa5-8893-eb031a3d7fe8 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1725 microversion: 2.1 time: 0.225571 Oct 20 14:45:54.304132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 314/616] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:54 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1725 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:54.479207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:54.491768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:54.492807 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:54.497049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:54.501170 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4e0f1a3a-7161-44dc-8d92-a1e1571d20ef tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.285413 Oct 20 14:45:54.505382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 303/617] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:54 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:54.506223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.506968 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.507624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.508730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.509200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.509629 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.625793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:54.628381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:54.635981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.636919 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.637566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.638798 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.639343 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.640655 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.674382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ecaeb2e6-dd76-49ce-9f0f-c2438c7bb577 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052674 Oct 20 14:45:54.681527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 304/618] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:45:54 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 14:45:54.749748 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:54.750247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:54.774307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.775553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.776119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.776924 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.777591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.778214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.786126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:54.804411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-69774c6a-006c-4429-b91e-27c851e2e2fa tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.316314 Oct 20 14:45:54.805611 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 315/619] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:54 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:54.818294 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:45:54.914009 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-053ad567-aca6-4092-a7f2-24aaf20cfdbf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 204 len: 0 microversion: 2.1 time: 0.167637 Oct 20 14:45:54.919056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 305/620] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:45:54 2022] DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 20 14:45:54.927272 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:54.927908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:54.934958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.935442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.936195 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.937537 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.938369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.939998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.963157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-23052aa2-ac4e-4b22-bf76-d65fadb2e55b req-c3ad4d95-b24b-4b4c-ba0c-af34c4491601 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bb0e5a-9c37-4177-858e-0f860a370f76", "tag": "ad316f32-43bd-4ee5-87a3-588ca6ffab22"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:54.978267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-23052aa2-ac4e-4b22-bf76-d65fadb2e55b req-c3ad4d95-b24b-4b4c-ba0c-af34c4491601 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:54.979010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-23052aa2-ac4e-4b22-bf76-d65fadb2e55b req-c3ad4d95-b24b-4b4c-ba0c-af34c4491601 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:54.979645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-23052aa2-ac4e-4b22-bf76-d65fadb2e55b req-c3ad4d95-b24b-4b4c-ba0c-af34c4491601 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:54.994530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-23052aa2-ac4e-4b22-bf76-d65fadb2e55b req-c3ad4d95-b24b-4b4c-ba0c-af34c4491601 service nova] Creating event network-changed:ad316f32-43bd-4ee5-87a3-588ca6ffab22 for instance a4bb0e5a-9c37-4177-858e-0f860a370f76 on hv-cinder-77923 Oct 20 14:45:54.999990 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-23052aa2-ac4e-4b22-bf76-d65fadb2e55b req-c3ad4d95-b24b-4b4c-ba0c-af34c4491601 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043224 Oct 20 14:45:55.001172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 306/621] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:55.181200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:55.189055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-17450860-d07e-4459-a7de-367e1122ed47 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1682 microversion: 2.1 time: 0.268848 Oct 20 14:45:55.189623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 316/622] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:54 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1682 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:55.325825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-ef0519fe-8a77-473c-8fe3-ef92c147cfc8 req-31c7022a-74f6-48ad-ad69-082bacb116c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10aa467-2dd1-482b-9e1e-1e1f43e1aafa", "tag": "a1e5a843-5c0f-440d-8b6e-9a45608a72c5"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:55.327083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:55.328522 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:55.335542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.336025 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.336510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:55.337211 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.337653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.338158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ef0519fe-8a77-473c-8fe3-ef92c147cfc8 req-31c7022a-74f6-48ad-ad69-082bacb116c4 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.338402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:55.338641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ef0519fe-8a77-473c-8fe3-ef92c147cfc8 req-31c7022a-74f6-48ad-ad69-082bacb116c4 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.339076 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-ef0519fe-8a77-473c-8fe3-ef92c147cfc8 req-31c7022a-74f6-48ad-ad69-082bacb116c4 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:55.356010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-ef0519fe-8a77-473c-8fe3-ef92c147cfc8 req-31c7022a-74f6-48ad-ad69-082bacb116c4 service nova] Creating event network-changed:a1e5a843-5c0f-440d-8b6e-9a45608a72c5 for instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa on hv-cinder-77923 Oct 20 14:45:55.361937 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-ef0519fe-8a77-473c-8fe3-ef92c147cfc8 req-31c7022a-74f6-48ad-ad69-082bacb116c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040192 Oct 20 14:45:55.362568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 307/623] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:55.470365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:55.478619 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f1d31004-e01e-4c84-ba52-39df0d7b4b41 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1725 microversion: 2.1 time: 0.155495 Oct 20 14:45:55.479192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 317/624] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:55 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:55.527957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:55.528742 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:55.534835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.535309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.535740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:55.536542 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.536995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.537458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:55.666631 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:55.674926 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9d615536-8cf3-472d-8cf0-693423105b2f tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.151152 Oct 20 14:45:55.675502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 308/625] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:55 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:55.828820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:55.829354 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:55.835280 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.835789 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.836221 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:55.836951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:55.837404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:55.837827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.206093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:56.212793 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:56.213412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:56.213899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-174fad94-231f-4b7b-9241-ad19dc674870 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.389096 Oct 20 14:45:56.214470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 318/626] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:55 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:56.220471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:56.220955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:56.221389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.222079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:56.222530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:56.222947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.355600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:56.364224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-540b719b-1aeb-4d4e-857d-8ee05b8237ca tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1682 microversion: 2.1 time: 0.155231 Oct 20 14:45:56.364827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 309/627] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:56 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1682 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:56.502603 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:56.503150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:56.509053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:56.509529 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:56.509955 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.510631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:56.511077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:56.511493 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.639075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:56.647880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c4c16483-8eb0-419d-ab1d-528b80566698 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1725 microversion: 2.1 time: 0.149689 Oct 20 14:45:56.648461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 319/628] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:56 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1725 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:56.697753 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:56.698365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:56.705366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:56.705851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:56.706284 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.706970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:56.707421 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:56.707844 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:56.833371 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:56.841041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d0cc6322-c8bd-4b7e-81c7-c1546da7c92d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.147166 Oct 20 14:45:56.841612 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 310/629] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:56 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:57.238295 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:57.238940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:57.245356 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.245837 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.246271 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.246954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.247408 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.247821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.378146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:57.385795 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-48e0bbcf-4aa6-4ffb-aaa4-6533a9ae1684 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.151988 Oct 20 14:45:57.386365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 320/630] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:57 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:57.386971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:57.387590 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:57.394097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.394576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.395006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.395699 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.396148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.396598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.524693 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:57.533075 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e1829def-2f9f-4cb0-846f-d54c222381ec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1682 microversion: 2.1 time: 0.149889 Oct 20 14:45:57.533642 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 311/631] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:57 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1682 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:57.671073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:57.671750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:57.677903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.678377 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.678805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.679482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.679930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.680364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.815103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:57.823281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-364285fd-4e4a-4d23-88f6-73ecda1533ba tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1725 microversion: 2.1 time: 0.156111 Oct 20 14:45:57.823872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 321/632] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:57 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:57.864337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:57.864983 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:57.870892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.871381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.871817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:57.872544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:57.873002 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:57.873431 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.006840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:58.014533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-39f2d222-7869-40e5-9139-ed1980b14aeb tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.154068 Oct 20 14:45:58.015645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 312/633] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:57 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:58.409251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:58.409958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:58.416928 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.417496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.417998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.418945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.419469 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.419956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.558403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:58.559575 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:58.569139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.569871 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.570314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.571020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.571658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.572091 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.653806 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:58.663484 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-97ff3b7b-b2b0-438f-b4e5-88f7f59e3211 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.258893 Oct 20 14:45:58.664317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 322/634] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:58 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:58.684993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:58.685490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:58.692900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.693395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.693834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.694548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.695002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.695428 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.722772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9cd28677-375f-4ddb-b8ad-4807d0028626 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/ips" status: 200 len: 152 microversion: 2.20 time: 0.041564 Oct 20 14:45:58.723616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 323/635] 10.222.0.13 () {60 vars in 1289 bytes} [Thu Oct 20 14:45:58 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/ips => generated 152 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:45:58.763615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:58.774923 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-657ddc35-ac4c-4621-9ba1-4f4b8b24549e tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1682 microversion: 2.1 time: 0.221269 Oct 20 14:45:58.776833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 313/636] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:58 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:58.847649 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:58.848274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:58.859303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.861613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.862177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:58.865625 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:58.866299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:58.867070 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.037653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:59.038069 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:59.047338 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.049445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.049898 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.050613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.051063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.055515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.164308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:59.177619 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cd02d399-f1e3-4f5c-a6b0-2fa880660024 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1731 microversion: 2.1 time: 0.334362 Oct 20 14:45:59.178315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 324/637] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:58 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1731 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:45:59.207423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:59.209233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:59.217543 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.218374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.218818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.219681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.220328 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.220805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.341875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:59.350503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b298186f-8d0d-4004-b489-df4240e995de tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.316705 Oct 20 14:45:59.350733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5d68b7b6-dcc7-4bb7-902b-0763b5391d0f tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.148489 Oct 20 14:45:59.352920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 325/638] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:45:59 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-interface => generated 285 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:59.361008 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 314/639] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:59 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:45:59.692127 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:59.692772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:59.697414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a71562ac-5f13-43c4-8982-37ff98b61512 req-c7d6859e-a17f-4f6f-aade-7a67b1b2351d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7254508-d290-4971-a856-7c9afb57161b", "name": "network-vif-deleted", "tag": "813487db-4806-4570-a1f7-f8c76f352e9e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:45:59.703684 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:59.704518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=14 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:59.709348 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.714186 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.714638 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.715352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.718662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.722313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a71562ac-5f13-43c4-8982-37ff98b61512 req-c7d6859e-a17f-4f6f-aade-7a67b1b2351d service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.723071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.726553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a71562ac-5f13-43c4-8982-37ff98b61512 req-c7d6859e-a17f-4f6f-aade-7a67b1b2351d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.726995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a71562ac-5f13-43c4-8982-37ff98b61512 req-c7d6859e-a17f-4f6f-aade-7a67b1b2351d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.752670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a71562ac-5f13-43c4-8982-37ff98b61512 req-c7d6859e-a17f-4f6f-aade-7a67b1b2351d service nova] Creating event network-vif-deleted:813487db-4806-4570-a1f7-f8c76f352e9e for instance c7254508-d290-4971-a856-7c9afb57161b on hv-cinder-77923 Oct 20 14:45:59.762187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a71562ac-5f13-43c4-8982-37ff98b61512 req-c7d6859e-a17f-4f6f-aade-7a67b1b2351d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074916 Oct 20 14:45:59.768012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 315/640] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:45:59.800774 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:45:59.804657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:45:59.817269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.818064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.818655 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.819515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:45:59.820219 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:45:59.820819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:45:59.834801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:45:59.936971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:45:59.944788 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-37b8bf33-2e3a-415a-8d12-cd68570a35f4 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1615 microversion: 2.1 time: 0.149183 Oct 20 14:45:59.945705 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 316/641] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:59 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1615 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:00.011266 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:00.020065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1cd9877c-960d-42c0-8a58-aeb3ec04f27b tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.336729 Oct 20 14:46:00.020822 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 326/642] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:45:59 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:00.383432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:00.384041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:00.402143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.402797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.403599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.404581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.405556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.406690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.586183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-f66588bd-6b41-44f4-9281-047e506c3d40 req-e80bf2c2-0129-4627-9737-bc5e68337dce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824af68b-a192-4a4d-8058-1ab7086ef986", "tag": "d15efa7b-2d55-44cf-a379-eaaae6f4f141"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:00.603889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f66588bd-6b41-44f4-9281-047e506c3d40 req-e80bf2c2-0129-4627-9737-bc5e68337dce service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.604553 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f66588bd-6b41-44f4-9281-047e506c3d40 req-e80bf2c2-0129-4627-9737-bc5e68337dce service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.605207 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f66588bd-6b41-44f4-9281-047e506c3d40 req-e80bf2c2-0129-4627-9737-bc5e68337dce service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.621485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-f66588bd-6b41-44f4-9281-047e506c3d40 req-e80bf2c2-0129-4627-9737-bc5e68337dce service nova] Creating event network-changed:d15efa7b-2d55-44cf-a379-eaaae6f4f141 for instance 824af68b-a192-4a4d-8058-1ab7086ef986 on hv-cinder-77923 Oct 20 14:46:00.630925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-f66588bd-6b41-44f4-9281-047e506c3d40 req-e80bf2c2-0129-4627-9737-bc5e68337dce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050723 Oct 20 14:46:00.632039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 327/643] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:00.643543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:00.656847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cca813d1-b20f-46fa-aa39-3351e42d7569 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.273597 Oct 20 14:46:00.658142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 317/644] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:00 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:00.659419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:00.660059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:00.670606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.672144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.672804 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.673693 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.674419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.675074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.703778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lazy-loading 'flavor' on Instance uuid 51cb557d-d0f7-4b32-bc95-04812c917244 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:46:00.726784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:00.931889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cd483e50-e42b-42f5-81df-b3deaaa17305 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/action" status: 202 len: 0 microversion: 2.20 time: 0.277221 Oct 20 14:46:00.937093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 328/645] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Oct 20 14:46:00 2022] POST /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/action => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:46:00.941282 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:00.941893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:00.954029 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.954291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.954732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.958971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.959668 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.960260 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.973916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:00.974759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:00.982201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.982840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.983414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:00.984283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:00.985547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:00.986053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:01.032591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:01.032997 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:01.033435 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:01.033897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'fault' on Instance uuid c7254508-d290-4971-a856-7c9afb57161b {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:46:01.097341 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:01.106487 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7fa3414e-da67-4441-90ba-09cad2c93bec tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 200 len: 1332 microversion: 2.1 time: 0.139844 Oct 20 14:46:01.107073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 329/646] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:00 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:01.138407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:01.142096 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:01.154646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:01.155503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:01.156283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:01.157188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:01.157802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:01.158540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:01.195512 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:01.205688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:01.207231 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:01.208772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a262128e-b7a4-4f14-b8ef-d39a2ae26915 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.271431 Oct 20 14:46:01.209533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 318/647] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:00 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:46:01.303126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:01.310862 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-409aa757-f71a-418d-a059-765f91129442 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.202627 Oct 20 14:46:01.311606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 330/648] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:01 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:01.681098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:01.681713 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:01.688283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:01.688785 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:01.689218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:01.689903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:01.690354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:01.690775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:01.694835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:01.847739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:01.856213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-34fc53dc-5004-4853-9d06-4f2babedc293 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.178655 Oct 20 14:46:01.856921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 319/649] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:01 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:02.129857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:02.130384 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:02.136713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.137191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.137614 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.138291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.138732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.139145 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.152631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b HTTP/1.1 Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:46:02.154216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:46:02.156447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'c7254508-d290-4971-a856-7c9afb57161b'} Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:46:02.157534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:46:02.159026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:02.160573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:46:02.160573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0013785f-0aa7-4ef9-ac7d-20ebe0a44135 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 404 len: 111 microversion: 2.1 time: 0.030271 Oct 20 14:46:02.160573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 331/650] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:02 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 14:46:02.164894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c20a2b79-2765-4c13-89f7-c480e977b2af tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '.version_select at 0x7f6344d67b80>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:02.182931 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c20a2b79-2765-4c13-89f7-c480e977b2af tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052121880" status: 202 len: 0 microversion: 2.1 time: 0.021774 Oct 20 14:46:02.183543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 320/651] 10.222.0.13 () {58 vars in 1221 bytes} [Thu Oct 20 14:46:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1052121880 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:46:02.235526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:02.236132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:02.242132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.242608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.243039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.243724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.244368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.244987 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.334850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:02.335588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:02.359244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.360031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.360725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.362065 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.362732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.363495 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.410762 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:02.422279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:02.425084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:02.427464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8969f0fe-61d6-49be-ae2f-a57a7352285a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.196293 Oct 20 14:46:02.433857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 332/652] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:02 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:02.534909 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:02.543118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bb506893-b994-4c66-9c05-9b5dc945e9fb tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.212504 Oct 20 14:46:02.543804 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 321/653] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:02 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:02.645415 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-109fccca-8141-4f7b-9cd4-6e057d5ab16e req-84d42e49-60c2-47df-b40f-0e18676639e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "824af68b-a192-4a4d-8058-1ab7086ef986", "tag": "d15efa7b-2d55-44cf-a379-eaaae6f4f141"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:02.654825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-109fccca-8141-4f7b-9cd4-6e057d5ab16e req-84d42e49-60c2-47df-b40f-0e18676639e0 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.656865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-109fccca-8141-4f7b-9cd4-6e057d5ab16e req-84d42e49-60c2-47df-b40f-0e18676639e0 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.657356 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-109fccca-8141-4f7b-9cd4-6e057d5ab16e req-84d42e49-60c2-47df-b40f-0e18676639e0 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.668607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-109fccca-8141-4f7b-9cd4-6e057d5ab16e req-84d42e49-60c2-47df-b40f-0e18676639e0 service nova] Creating event network-changed:d15efa7b-2d55-44cf-a379-eaaae6f4f141 for instance 824af68b-a192-4a4d-8058-1ab7086ef986 on hv-cinder-77923 Oct 20 14:46:02.673523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-109fccca-8141-4f7b-9cd4-6e057d5ab16e req-84d42e49-60c2-47df-b40f-0e18676639e0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031756 Oct 20 14:46:02.674544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 333/654] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:02.881167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:02.881927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:02.888031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.888646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.889147 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.890043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:02.890588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:02.891025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:02.946579 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0ae261a6-9f87-4767-baed-5a7e4aca068d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: .version_select at 0x7f6344defd30>, body: {"keypair": {"name": "tempest-keypair-2102424228", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNViki2Aeyjlf3WInbfDIiKy6nCTUhfH18H1eYAFdmDCH5heEKeqdc0TXo6SWRaOYLLdz5TTz+XTAbGmm5h8goBYV/DbT2U41M+o5Zudhp5F6LFN/BczssLWqvKXS9SYMg=="}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:02.973455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-0ae261a6-9f87-4767-baed-5a7e4aca068d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:46:02.977026 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-0ae261a6-9f87-4767-baed-5a7e4aca068d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:46:03.003624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0ae261a6-9f87-4767-baed-5a7e4aca068d tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.061389 Oct 20 14:46:03.005300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 334/655] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:46:02 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:03.055790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:03.065392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3cf65656-831e-47a4-b58e-ee03025acd65 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.187994 Oct 20 14:46:03.066114 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 322/656] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:02 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:03.456117 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:03.456985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:03.463553 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:03.464217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:03.464656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:03.466051 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:03.466513 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:03.466934 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:03.567916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:03.568717 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:03.576114 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:03.576978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:03.577547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:03.578419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:03.579346 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:03.579778 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:03.723282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:03.733099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:03.745187 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:03.746699 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-67e627d7-f943-4b81-b3b5-e48624cbf264 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.296365 Oct 20 14:46:03.751339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 335/657] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:03 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:03.848957 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:03.859136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bc6c5aad-c634-4a1e-8bb3-aa5a11f64ce5 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.294363 Oct 20 14:46:03.859736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 323/658] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:03 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:04.089292 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:04.089911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:04.097253 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.097849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.098340 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:04.099260 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.099715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.100329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:04.318896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:04.326598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f3bc3802-1592-4a48-b953-1fb3ea38df68 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.241380 Oct 20 14:46:04.328134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 336/659] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:04 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:04.497987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-6e60ed46-f577-4816-9d9b-ecd25021e689 req-71305cc6-9d28-465e-94ca-786f75eecec9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10aa467-2dd1-482b-9e1e-1e1f43e1aafa", "name": "network-vif-plugged", "status": "completed", "tag": "a1e5a843-5c0f-440d-8b6e-9a45608a72c5"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:04.508715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6e60ed46-f577-4816-9d9b-ecd25021e689 req-71305cc6-9d28-465e-94ca-786f75eecec9 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.509201 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6e60ed46-f577-4816-9d9b-ecd25021e689 req-71305cc6-9d28-465e-94ca-786f75eecec9 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.510310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6e60ed46-f577-4816-9d9b-ecd25021e689 req-71305cc6-9d28-465e-94ca-786f75eecec9 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:04.522992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6e60ed46-f577-4816-9d9b-ecd25021e689 req-71305cc6-9d28-465e-94ca-786f75eecec9 service nova] Creating event network-vif-plugged:a1e5a843-5c0f-440d-8b6e-9a45608a72c5 for instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa on hv-cinder-77923 Oct 20 14:46:04.528074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-6e60ed46-f577-4816-9d9b-ecd25021e689 req-71305cc6-9d28-465e-94ca-786f75eecec9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033928 Oct 20 14:46:04.528840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 324/660] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:46:04.779252 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:04.779863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:04.787995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.788640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.789134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:04.790077 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.790596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.791226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:04.835703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1247083008", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bc51d155-90b9-48b7-86e9-fc4346955e9e"}], "security_groups": [{"name": "tempest-securitygroup--1470646502"}], "key_name": "tempest-keypair-2102424228", "user_data": "}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:04.967216 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:04.969660 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] validate_networks() for [('bc51d155-90b9-48b7-86e9-fc4346955e9e', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:46:04.975978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:04.977473 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:04.978632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a3f92873-0ade-440b-b0a0-590b60cbae78 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.203702 Oct 20 14:46:04.979196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 337/661] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:04 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:04.985650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:04.985650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:04.991076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.991564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.991996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:04.992716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:04.993169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:04.993593 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:05.179114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:05.187129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7faa2775-d98f-4642-93fc-619b46cfa466 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.206925 Oct 20 14:46:05.188036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 338/662] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:04 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:05.349999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:05.350746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:05.357403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:05.357889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:05.359441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:05.360148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:05.360630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:05.361060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:05.443366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:46:05.443794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:46:05.444297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:46:05.444728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:46:05.445139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:46:05.454333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:05.454817 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:05.455250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:05.455982 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:05.456458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:05.456884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:05.474448 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:46:05.478390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Getting quotas for user e0d4be0e0f744242a323ac9694aef9ad and project 8d8d1dfd3c714794a3fca61b2c6b093e. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:46:05.490619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:46:05.493056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:46:05.515772 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:05.523580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-80495175-a006-4008-88b8-831ada2039ee tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1358 microversion: 2.1 time: 0.177374 Oct 20 14:46:05.524206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 339/663] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:05 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:05.549573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6ed2cf20-8800-4449-8a9e-924e42101731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.719026 Oct 20 14:46:05.550211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 325/664] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:46:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 721 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 14:46:05.563991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d16716f0-690a-48eb-a56b-66bce86ea67c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:05.564637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d16716f0-690a-48eb-a56b-66bce86ea67c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:05.617058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d16716f0-690a-48eb-a56b-66bce86ea67c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:05.624043 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d16716f0-690a-48eb-a56b-66bce86ea67c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1242 microversion: 2.1 time: 0.064398 Oct 20 14:46:05.624725 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 340/665] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:05 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1242 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:06.063896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:06.064649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:06.072184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.072702 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.073138 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.074581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.075033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.075459 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.207111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:06.211848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:06.212585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:06.215821 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:06.217270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:06.218432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-98c4ded3-dee6-4349-8c50-7a679d2dbfbb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.216547 Oct 20 14:46:06.226915 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 326/666] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:06 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:06.227057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.227057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.227057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.227057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.227412 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.227412 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.350010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:06.357889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-caee140a-388f-436a-a16c-0cea3e206c62 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.149771 Oct 20 14:46:06.358475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 341/667] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:06 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:06.548037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:06.548604 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:06.554530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.555010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.555442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.556122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.556629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.557043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.683096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:06.691776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-58e1bf0b-d542-4989-b215-5f6b18cd2e3d tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1544 microversion: 2.1 time: 0.148265 Oct 20 14:46:06.692365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 327/668] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:06 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1544 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:06.704449 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:06.705065 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:06.710963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.711448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.711883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.712595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.713048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.713469 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.714089 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:06.714586 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:06.720482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.720970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.721413 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.722107 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:06.722576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:06.722987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:06.798829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:06.806276 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ee837f11-441a-4dff-b52d-bc220f452268 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1246 microversion: 2.1 time: 0.163549 Oct 20 14:46:06.806843 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 342/669] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:06 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1246 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:06.817494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-04ee2143-f0e2-4293-adee-876aef872075 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107104 Oct 20 14:46:06.818085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 328/670] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:46:06 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:46:07.244799 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:07.245413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:07.252566 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.253141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.253763 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.254485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.254937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.255432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.382057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:07.382756 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:07.390544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.391429 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.392102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.393037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.393606 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.394131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.551740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:07.560809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:07.562446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:07.563722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-05c830a2-9477-4c34-968e-01855d64496b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.323097 Oct 20 14:46:07.564561 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 343/671] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:07 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:07.644200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:07.651827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d9e5f29b-c033-4ed4-a749-5bfbbc1d6bb1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.274845 Oct 20 14:46:07.652412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 329/672] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:07 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:07.829907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:07.830516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:07.836624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.837107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.837544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.838236 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.838686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.839105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.931002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:07.934066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-c879aee1-48a1-417d-9cf1-3a29eca6febe req-ad236adf-78ed-48ad-8092-dacd828cffe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d10aa467-2dd1-482b-9e1e-1e1f43e1aafa", "tag": "a1e5a843-5c0f-440d-8b6e-9a45608a72c5"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:07.939752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5498c326-eb19-4f5e-8275-93321c1049ce tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1294 microversion: 2.1 time: 0.114382 Oct 20 14:46:07.940634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 344/673] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:07 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1294 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:07.949149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c879aee1-48a1-417d-9cf1-3a29eca6febe req-ad236adf-78ed-48ad-8092-dacd828cffe1 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:07.949624 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c879aee1-48a1-417d-9cf1-3a29eca6febe req-ad236adf-78ed-48ad-8092-dacd828cffe1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:07.950052 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-c879aee1-48a1-417d-9cf1-3a29eca6febe req-ad236adf-78ed-48ad-8092-dacd828cffe1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:07.974619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-c879aee1-48a1-417d-9cf1-3a29eca6febe req-ad236adf-78ed-48ad-8092-dacd828cffe1 service nova] Creating event network-changed:a1e5a843-5c0f-440d-8b6e-9a45608a72c5 for instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa on hv-cinder-77923 Oct 20 14:46:07.980202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-c879aee1-48a1-417d-9cf1-3a29eca6febe req-ad236adf-78ed-48ad-8092-dacd828cffe1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050054 Oct 20 14:46:07.985249 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 330/674] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:46:08.589755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:08.590370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:08.598080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:08.598616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:08.599244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:08.600141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:08.600623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:08.601209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:08.677538 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:08.679113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:08.690288 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:08.691009 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:08.692944 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:08.693924 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:08.694552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:08.695142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:08.787138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:08.796526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:08.798211 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:08.799588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-eb8cd68a-76cf-4033-a055-900b63745494 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.213758 Oct 20 14:46:08.800708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 345/675] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:08 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:08.883306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:08.901812 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-90689ca3-881d-4319-8864-e1545dbc893e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.229207 Oct 20 14:46:08.902496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 331/676] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:08 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:08.963477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:08.964411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:08.970847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:08.971342 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:08.971774 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:08.972580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:08.973030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:08.973733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:09.043415 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:09.047550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:09.053226 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-12fbef50-8608-4028-ba02-0348da9750b0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1300 microversion: 2.1 time: 0.093648 Oct 20 14:46:09.054461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 346/677] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:08 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1300 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:09.827213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:09.827763 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:09.834564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:09.835109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:09.835541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:09.836277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:09.836844 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:09.837261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:09.863628 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-3f5e99aa-8d31-4014-ba3b-9a8a8550ad68 req-eaf100d3-282d-4bf0-9c54-4863482b9440 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4caff2a-4143-4567-bb70-554451cc1b0d", "tag": "1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:09.876092 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-3f5e99aa-8d31-4014-ba3b-9a8a8550ad68 req-eaf100d3-282d-4bf0-9c54-4863482b9440 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:09.876744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-3f5e99aa-8d31-4014-ba3b-9a8a8550ad68 req-eaf100d3-282d-4bf0-9c54-4863482b9440 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:09.877288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-3f5e99aa-8d31-4014-ba3b-9a8a8550ad68 req-eaf100d3-282d-4bf0-9c54-4863482b9440 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:09.900308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-3f5e99aa-8d31-4014-ba3b-9a8a8550ad68 req-eaf100d3-282d-4bf0-9c54-4863482b9440 service nova] Creating event network-changed:1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368 for instance e4caff2a-4143-4567-bb70-554451cc1b0d on hv-cinder-77923 Oct 20 14:46:09.906194 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-3f5e99aa-8d31-4014-ba3b-9a8a8550ad68 req-eaf100d3-282d-4bf0-9c54-4863482b9440 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045988 Oct 20 14:46:09.907024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 347/678] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:46:09.927249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:09.928088 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:09.935308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:09.936108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:09.936576 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:09.937285 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:09.938134 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:09.938289 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:10.032536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:10.041210 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:10.042892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:10.044158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c631e023-e76c-4035-a120-d5fb7f93cebf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.221050 Oct 20 14:46:10.044941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 332/679] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:09 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:10.078899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:10.079438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:10.085775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:10.086261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:10.086695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:10.087396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:10.087854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:10.088281 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:10.103942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:10.112000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4de908be-eca2-45f3-a61e-da333fedb1b1 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.189002 Oct 20 14:46:10.112632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 348/680] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:09 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:10.219636 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:10.227425 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0e5354ba-3b09-4476-95c5-b470cfbb5dcd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.152680 Oct 20 14:46:10.228003 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 333/681] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:10 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:11.071223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:11.071827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:11.079206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:11.079688 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:11.080115 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:11.080849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:11.081293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:11.081717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:11.136884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:11.137397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:11.145298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:11.145896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:11.146338 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:11.147424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:11.148101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:11.148291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:11.254962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:11.263291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:11.265341 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:11.266491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ae10a196-21d8-4407-8625-300eb6551917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.199355 Oct 20 14:46:11.267051 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 349/682] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:11 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:11.271500 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:11.272089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:11.277865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:11.279231 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:11.279766 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:11.280543 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:11.281152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:11.281730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:11.303149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:11.310986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d05fd2fb-1575-4bbe-a6c7-df5e174a0265 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.177922 Oct 20 14:46:11.312358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 334/683] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:11 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:11.409566 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:11.417458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d50fb887-0c75-463d-8e72-2060dd0b0ef8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.149473 Oct 20 14:46:11.418035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 350/684] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:11 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:12.291481 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:12.292097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:12.298578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.299060 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.299490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.300168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.300643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.301060 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.334759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:12.335467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:12.343109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.343701 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.344146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.344891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.345366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.345777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.491490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:12.499802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:12.501501 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:12.502764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-281b8ce4-8917-435b-aaf9-6fc11b27e164 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.215189 Oct 20 14:46:12.503558 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 335/685] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:12 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:12.508210 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:12.509132 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:12.515567 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.516311 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.516986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.517906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.518574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.519211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.524163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:12.534071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-343cd42e-fa39-4a9c-9e65-9ac7dc016ac9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.203084 Oct 20 14:46:12.535306 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 351/686] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:12 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:12.544743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-40cad721-b3d0-4cf2-8b63-c85a43188e65 req-72b86e61-b69b-4d47-b245-8dad34f5b842 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bb0e5a-9c37-4177-858e-0f860a370f76", "name": "network-vif-plugged", "status": "completed", "tag": "ad316f32-43bd-4ee5-87a3-588ca6ffab22"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:12.558197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-40cad721-b3d0-4cf2-8b63-c85a43188e65 req-72b86e61-b69b-4d47-b245-8dad34f5b842 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:12.558965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-40cad721-b3d0-4cf2-8b63-c85a43188e65 req-72b86e61-b69b-4d47-b245-8dad34f5b842 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:12.559546 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-40cad721-b3d0-4cf2-8b63-c85a43188e65 req-72b86e61-b69b-4d47-b245-8dad34f5b842 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:12.573110 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-40cad721-b3d0-4cf2-8b63-c85a43188e65 req-72b86e61-b69b-4d47-b245-8dad34f5b842 service nova] Creating event network-vif-plugged:ad316f32-43bd-4ee5-87a3-588ca6ffab22 for instance a4bb0e5a-9c37-4177-858e-0f860a370f76 on hv-cinder-77923 Oct 20 14:46:12.580317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-40cad721-b3d0-4cf2-8b63-c85a43188e65 req-72b86e61-b69b-4d47-b245-8dad34f5b842 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041739 Oct 20 14:46:12.581364 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 352/687] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:12.658999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:12.666797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f17a74e3-d8c3-4f3a-bf65-7fdb4e9e4124 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.162020 Oct 20 14:46:12.667366 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 336/688] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:12 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:13.530221 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:13.530891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:13.536939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:13.537432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:13.537836 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:13.538511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:13.538956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:13.539374 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:13.558037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:13.558794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:13.565890 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:13.566375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:13.566811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:13.567506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:13.567960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:13.568407 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:13.734264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:13.743106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:13.744572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:13.745734 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b330fd81-4d29-4ea3-a1c4-0f95553afb6a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.220438 Oct 20 14:46:13.746300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 353/689] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:13 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:13.747776 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:13.751858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:13.752569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:13.755607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8decc138-102b-48b0-b147-6d3bdb890b5c tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1264 microversion: 2.1 time: 0.201469 Oct 20 14:46:13.756384 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 337/690] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:13 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1264 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:13.759053 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:13.759607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:13.760174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:13.761019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:13.761538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:13.762076 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:13.913696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:13.922094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3dd254f9-d2da-4bec-a38f-6f3206ad1d97 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.174106 Oct 20 14:46:13.922671 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 354/691] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:13 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:14.771175 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:14.771825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:14.777687 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:14.778287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:14.778543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:14.779021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:14.779454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:14.780143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:14.780613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:14.781031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:14.784570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:14.785052 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:14.785482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:14.786245 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:14.786692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:14.787111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:14.974320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:14.984231 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:14.984426 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:14.985950 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:14.987189 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-31f2d4fe-aeaf-413f-84aa-26830fee170b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.220002 Oct 20 14:46:14.994943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e83fffd5-21ca-40b9-aaaf-8b0f9aff1979 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1449 microversion: 2.1 time: 0.221048 Oct 20 14:46:14.996850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 338/692] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:14 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:15.002561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:15.003280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:15.005631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 355/693] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:14 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1449 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:15.006369 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:15.011110 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:15.011518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:15.011959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:15.012690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:15.013360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:15.013639 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:15.019002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:15.019409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:15.019547 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:15.025521 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:15.026016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:15.026441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:15.027141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:15.027859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:15.028002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:15.218412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:15.221952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:15.226234 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-697de6a8-3e90-4b1d-86be-accddc14b122 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.228068 Oct 20 14:46:15.226819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 339/694] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:14 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:15.229594 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9840336f-9c10-4edd-b99b-c4cd4bc2d4f6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1449 microversion: 2.1 time: 0.215139 Oct 20 14:46:15.230149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 356/695] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:15 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1449 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:16.013488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:16.014818 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:16.016796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:16.017519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:16.023607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:16.024166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:16.024701 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:16.025463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:16.025987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:16.026478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:16.250362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:16.251126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:16.253359 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:16.259355 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:16.259846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:16.260282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:16.261011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:16.261538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:16.261875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:16.265391 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:16.274336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:16.275964 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:16.277283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b09d71b8-3513-416a-b35a-5411acddaa02 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.267734 Oct 20 14:46:16.277961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 340/696] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:16 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:46:16.452188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:16.459422 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3082636f-0873-4e56-a86d-2bd8f9e9a6ed tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.213380 Oct 20 14:46:16.474486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 357/697] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:16 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:16.576745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-6682ee82-8434-47f2-8fcd-a80f497971c6 req-6a42cdea-ef91-4bed-a535-411d15b510b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4caff2a-4143-4567-bb70-554451cc1b0d", "name": "network-vif-plugged", "status": "completed", "tag": "1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:16.587958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6682ee82-8434-47f2-8fcd-a80f497971c6 req-6a42cdea-ef91-4bed-a535-411d15b510b2 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:16.589187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6682ee82-8434-47f2-8fcd-a80f497971c6 req-6a42cdea-ef91-4bed-a535-411d15b510b2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:16.589689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6682ee82-8434-47f2-8fcd-a80f497971c6 req-6a42cdea-ef91-4bed-a535-411d15b510b2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:16.601363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6682ee82-8434-47f2-8fcd-a80f497971c6 req-6a42cdea-ef91-4bed-a535-411d15b510b2 service nova] Creating event network-vif-plugged:1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368 for instance e4caff2a-4143-4567-bb70-554451cc1b0d on hv-cinder-77923 Oct 20 14:46:16.606727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-6682ee82-8434-47f2-8fcd-a80f497971c6 req-6a42cdea-ef91-4bed-a535-411d15b510b2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 Oct 20 14:46:16.607969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 341/698] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:17.121793 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-9b299f5e-aeb0-4021-bfbb-48a56382645d req-7196f51c-9ba8-4d17-8110-3f17b364d7a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bb0e5a-9c37-4177-858e-0f860a370f76", "tag": "ad316f32-43bd-4ee5-87a3-588ca6ffab22"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:17.128404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:17.135634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-9b299f5e-aeb0-4021-bfbb-48a56382645d req-7196f51c-9ba8-4d17-8110-3f17b364d7a8 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:17.136087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-9b299f5e-aeb0-4021-bfbb-48a56382645d req-7196f51c-9ba8-4d17-8110-3f17b364d7a8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:17.136568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-9b299f5e-aeb0-4021-bfbb-48a56382645d req-7196f51c-9ba8-4d17-8110-3f17b364d7a8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:17.149605 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-9b299f5e-aeb0-4021-bfbb-48a56382645d req-7196f51c-9ba8-4d17-8110-3f17b364d7a8 service nova] Creating event network-changed:ad316f32-43bd-4ee5-87a3-588ca6ffab22 for instance a4bb0e5a-9c37-4177-858e-0f860a370f76 on hv-cinder-77923 Oct 20 14:46:17.155656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-9b299f5e-aeb0-4021-bfbb-48a56382645d req-7196f51c-9ba8-4d17-8110-3f17b364d7a8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036366 Oct 20 14:46:17.156379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 358/699] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:17.304792 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:17.305503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:17.313780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:17.314277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:17.315222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:17.315936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:17.317209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:17.317209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:17.450435 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:17.459592 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:17.461232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:17.462412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1e0e0e28-29cc-4f4b-aafb-6c711f775bc4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1745 microversion: 2.20 time: 0.163028 Oct 20 14:46:17.463161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 342/700] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:17 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1745 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:17.483389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:17.484036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:17.490621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:17.491117 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:17.491735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:17.492484 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:17.493066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:17.493506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:17.645419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:17.652848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6a3e9d12-2436-4d16-8aca-bd7237a721e7 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1368 microversion: 2.1 time: 0.175561 Oct 20 14:46:17.653403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 359/701] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:17 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1368 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:18.488270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:18.488921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:18.495241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:18.495724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:18.496162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:18.496889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:18.497345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:18.497769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:18.626149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:18.634408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:18.635849 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:18.637045 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-25f0df59-429a-4be8-88f5-1073eba77917 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1745 microversion: 2.20 time: 0.152656 Oct 20 14:46:18.637607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 343/702] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:18 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:46:18.677074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:18.677936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:18.684291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:18.684803 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:18.685234 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:18.686295 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:18.686760 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:18.687181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:18.820901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:18.828897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-19990084-e518-4104-ba7d-7516532056da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1558 microversion: 2.1 time: 0.155776 Oct 20 14:46:18.829490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 360/703] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:18 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:18.851768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:18.852261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:18.862908 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:18.863322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:18.863754 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:18.864481 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:18.864929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:18.865373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:18.940916 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-33e3c7d5-a5d7-4164-9be7-c89565fa37bc tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092931 Oct 20 14:46:18.941508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 344/704] 10.222.0.13 () {58 vars in 1275 bytes} [Thu Oct 20 14:46:18 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:19.663667 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:19.664305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:19.670914 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:19.671358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:19.671828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:19.672545 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:19.673000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:19.673420 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:19.859118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:19.866899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:19.868483 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:19.869721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2f04a3c3-07a8-4179-9015-4e26bedbd521 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1745 microversion: 2.20 time: 0.209948 Oct 20 14:46:19.870451 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 361/705] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:19 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1745 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:46:20.250562 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-7b02743a-5841-466f-9ef2-54e1767df4b5 req-52a61719-26ff-43d6-928c-55946e468f22 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e4caff2a-4143-4567-bb70-554451cc1b0d", "tag": "1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:20.261408 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7b02743a-5841-466f-9ef2-54e1767df4b5 req-52a61719-26ff-43d6-928c-55946e468f22 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:20.261958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7b02743a-5841-466f-9ef2-54e1767df4b5 req-52a61719-26ff-43d6-928c-55946e468f22 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:20.262392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-7b02743a-5841-466f-9ef2-54e1767df4b5 req-52a61719-26ff-43d6-928c-55946e468f22 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:20.276833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-7b02743a-5841-466f-9ef2-54e1767df4b5 req-52a61719-26ff-43d6-928c-55946e468f22 service nova] Creating event network-changed:1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368 for instance e4caff2a-4143-4567-bb70-554451cc1b0d on hv-cinder-77923 Oct 20 14:46:20.282395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-7b02743a-5841-466f-9ef2-54e1767df4b5 req-52a61719-26ff-43d6-928c-55946e468f22 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099440 Oct 20 14:46:20.284706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 345/706] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:20.443177 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1830182726"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:20.444044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:20.456108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:20.459163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:20.459758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:20.460653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:20.463875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:20.464516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:20.705551 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.network.security_group_api [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Removing security group 85788e2a-e563-4b22-a334-f1d6f3aefa63 from port 7737f129-fde2-4080-b32b-e42c5e55b1b7 Oct 20 14:46:20.790527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-71e34f49-2187-411b-bfda-7e4b10e655d7 req-98869cf2-06e0-45e8-a4ba-1f996e4763a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "name": "network-vif-plugged", "status": "completed", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:20.816218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-71e34f49-2187-411b-bfda-7e4b10e655d7 req-98869cf2-06e0-45e8-a4ba-1f996e4763a0 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:20.818080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-71e34f49-2187-411b-bfda-7e4b10e655d7 req-98869cf2-06e0-45e8-a4ba-1f996e4763a0 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:20.820861 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-71e34f49-2187-411b-bfda-7e4b10e655d7 req-98869cf2-06e0-45e8-a4ba-1f996e4763a0 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:20.851691 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-71e34f49-2187-411b-bfda-7e4b10e655d7 req-98869cf2-06e0-45e8-a4ba-1f996e4763a0 service nova] Creating event network-vif-plugged:20cf55bd-3d91-4bda-9c08-8252ca71c6a7 for instance 51cb557d-d0f7-4b32-bc95-04812c917244 on hv-cinder-77923 Oct 20 14:46:20.869592 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-71e34f49-2187-411b-bfda-7e4b10e655d7 req-98869cf2-06e0-45e8-a4ba-1f996e4763a0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082131 Oct 20 14:46:20.871696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 346/707] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:20.900270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:20.903775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:20.915026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:20.917067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:20.918207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:20.920159 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:20.921018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:20.922245 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:21.159440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:21.170440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:21.173452 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:21.174777 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d36afb6b-c2d8-4990-9e05-ca84337449d9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.280266 Oct 20 14:46:21.176088 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 347/708] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:20 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:21.351930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-88f10b4e-54e3-4776-a0f9-705344997d54 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/action" status: 202 len: 0 microversion: 2.1 time: 0.923360 Oct 20 14:46:21.353273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 362/709] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:46:20 2022] POST /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/action => generated 0 bytes in 926 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:46:22.258887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:22.260256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:22.267550 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:22.268436 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:22.269108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:22.269955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:22.270616 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:22.271163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:22.333258 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-03b04190-df2f-4ab8-a360-3cb5df9a1cc3 req-6691fdc6-c916-43d6-8157-08e921bb0645 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:22.377428 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-03b04190-df2f-4ab8-a360-3cb5df9a1cc3 req-6691fdc6-c916-43d6-8157-08e921bb0645 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:22.378142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-03b04190-df2f-4ab8-a360-3cb5df9a1cc3 req-6691fdc6-c916-43d6-8157-08e921bb0645 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:22.379299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-03b04190-df2f-4ab8-a360-3cb5df9a1cc3 req-6691fdc6-c916-43d6-8157-08e921bb0645 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:22.395427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-03b04190-df2f-4ab8-a360-3cb5df9a1cc3 req-6691fdc6-c916-43d6-8157-08e921bb0645 service nova] Creating event network-changed:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:46:22.400722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-03b04190-df2f-4ab8-a360-3cb5df9a1cc3 req-6691fdc6-c916-43d6-8157-08e921bb0645 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072859 Oct 20 14:46:22.401787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 363/710] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:22.689006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:22.701922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:22.710244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:22.711391 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-22c23da5-4d89-4fd6-91e0-b03627c0b7bc tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.456869 Oct 20 14:46:22.712657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 348/711] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:22 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:22.805716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:22.806427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:22.818284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:22.819200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:22.825646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:22.826834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:22.827526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:22.828170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:22.947691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lazy-loading 'services' on Instance uuid 396b3353-8853-4ac0-abcd-98f55e471826 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:46:23.136503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4f7ce72d-074e-46f5-9005-60d94d7d6fa5 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments/a7769d61-901f-49dc-ad78-9307c978699b" status: 202 len: 0 microversion: 2.1 time: 0.335172 Oct 20 14:46:23.143083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 364/712] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:46:22 2022] DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments/a7769d61-901f-49dc-ad78-9307c978699b => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:46:23.149475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:23.152374 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:23.161480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:23.162383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:23.163114 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:23.164173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:23.165020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:23.166164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:23.257505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-06bbba9a-5cee-49e1-a204-2f031c147d53 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.113239 Oct 20 14:46:23.258099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 349/713] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:23 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments => generated 197 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:23.744870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:23.745902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:23.760513 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:23.767183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:23.768074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:23.772940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:23.773729 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:23.774386 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:24.004860 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:24.009011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:24.053922 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:24.055523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:24.056905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fc38e68e-c677-4bee-8d27-e1094e280509 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.316557 Oct 20 14:46:24.057616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 365/714] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:23 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:24.270360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:24.274554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:24.293292 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:24.293921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:24.294425 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:24.295422 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:24.295970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:24.296531 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:24.331102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e4c96020-d38a-448f-b783-2f10cb4b1a9d tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.064240 Oct 20 14:46:24.333768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 350/715] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:24 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 14:46:24.344239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:24.345073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:24.351511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:24.352264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:24.352725 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:24.353605 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:24.354217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:24.355222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:24.425912 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-3c6d73da-3ea0-4937-b2f2-bb5cef794140 req-ed879335-9fe9-46b5-a05c-d889b556d3d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:24.437094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3c6d73da-3ea0-4937-b2f2-bb5cef794140 req-ed879335-9fe9-46b5-a05c-d889b556d3d7 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:24.437830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3c6d73da-3ea0-4937-b2f2-bb5cef794140 req-ed879335-9fe9-46b5-a05c-d889b556d3d7 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:24.438515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3c6d73da-3ea0-4937-b2f2-bb5cef794140 req-ed879335-9fe9-46b5-a05c-d889b556d3d7 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:24.453124 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-3c6d73da-3ea0-4937-b2f2-bb5cef794140 req-ed879335-9fe9-46b5-a05c-d889b556d3d7 service nova] Creating event network-changed:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:46:24.455361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] HTTP exception thrown: Instance 396b3353-8853-4ac0-abcd-98f55e471826 is not attached to volume a7769d61-901f-49dc-ad78-9307c978699b Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Request method failure captured: Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments/a7769d61-901f-49dc-ad78-9307c978699b HTTP/1.1 Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV6u9CFw_PEHTzXdS0qwwvw5YkXJcSJKxdYGXPjDORRL_ODpWORPO5jV2XhxyWLcKpHRHGNenm-YSTVhKWfPiCmI5kttRAXyl0PeWrOZacYRlcuobKB263Dv6u23RcvRFHD6bJj0qMrKiZMVixL-UJPDTzUWqCOld1nsNmu01cRytns Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: adc778cfb32049d5844da08c78ba014a Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-TestMinimumBasicScenario-1366829823 Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:46:24.457989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_adc778cfb32049d5844da08c78ba014a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/adc778cfb32049d5844da08c78ba014a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adc778cfb32049d5844da08c78ba014a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adc778cfb32049d5844da08c78ba014a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-TestMinimumBasicScenario-1366829823 Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: adc778cfb32049d5844da08c78ba014a Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1366829823 Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-TestMinimumBasicScenario-1366829823-project Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 95515d28733f4c7e837eee5673346901 Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-TestMinimumBasicScenario-1366829823-project Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:46:24.461011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 396b3353-8853-4ac0-abcd-98f55e471826 is not attached to volume a7769d61-901f-49dc-ad78-9307c978699b Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'server_id': '396b3353-8853-4ac0-abcd-98f55e471826', 'id': 'a7769d61-901f-49dc-ad78-9307c978699b'} Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a7769d61-901f-49dc-ad78-9307c978699b. Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:46:24.461952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396b3353-8853-4ac0-abcd-98f55e471826 is not attached to volume a7769d61-901f-49dc-ad78-9307c978699b Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396b3353-8853-4ac0-abcd-98f55e471826 is not attached to volume a7769d61-901f-49dc-ad78-9307c978699b Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:24.463395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Returning 404 to user: Instance 396b3353-8853-4ac0-abcd-98f55e471826 is not attached to volume a7769d61-901f-49dc-ad78-9307c978699b {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:46:24.464719 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-10744047-d490-42b2-a28c-4939a893f523 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments/a7769d61-901f-49dc-ad78-9307c978699b" status: 404 len: 154 microversion: 2.1 time: 0.119877 Oct 20 14:46:24.469706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-3c6d73da-3ea0-4937-b2f2-bb5cef794140 req-ed879335-9fe9-46b5-a05c-d889b556d3d7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047304 Oct 20 14:46:24.470644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 351/716] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:24.473904 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 366/717] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:46:24 2022] DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826/os-volume_attachments/a7769d61-901f-49dc-ad78-9307c978699b => generated 154 bytes in 134 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:46:25.086747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:25.087952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:25.097892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:25.098780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:25.099303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:25.100023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:25.100609 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:25.101103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:25.258720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:25.270359 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:25.272160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:25.273469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2a3d3f22-1f54-46af-9eaf-c315f14edd23 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.191552 Oct 20 14:46:25.274196 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 352/718] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:25 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:25.645725 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:25.647333 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:25.657172 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:25.658689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:25.659432 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:25.660142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:25.660921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:25.661510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:25.690328 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:46:25.784808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6ba9784c-665a-4359-afb1-c0597626245f tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 204 len: 0 microversion: 2.1 time: 0.142556 Oct 20 14:46:25.787657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 367/719] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:46:25 2022] DELETE /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:46:25.795979 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:25.796720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:25.806477 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:25.807239 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:25.807674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:25.808392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:25.808997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:25.809591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:25.954697 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:25.963102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9bf4531f-8d70-4ec6-bd92-c4570665fcff tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1554 microversion: 2.1 time: 0.171157 Oct 20 14:46:25.963800 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 353/720] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:25 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1554 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:26.303147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:26.303965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:26.313359 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:26.313359 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:26.313658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:26.314309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:26.314823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:26.315367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:26.476179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:26.485653 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:26.487355 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:26.488543 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-67b42ec1-09c1-4eaa-91a3-603a05dd0a5a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.190840 Oct 20 14:46:26.489284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 368/721] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:26 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:26.991326 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:26.992865 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:27.000581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:27.001418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:27.001853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:27.002593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:27.003043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:27.003463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:27.161064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:27.169139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c04b9f4c-6dae-41ee-bea2-49c7a0273b07 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1554 microversion: 2.1 time: 0.181483 Oct 20 14:46:27.169978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 354/722] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:26 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:27.515822 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:27.517330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:27.523993 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:27.524503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:27.524936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:27.525629 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:27.526072 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:27.526486 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:27.681066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:27.692507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:27.693951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:27.695118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-12bcaaee-65c5-4195-9105-c842c2c3090e tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.183845 Oct 20 14:46:27.695688 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 369/723] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:27 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:28.198312 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:28.199759 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:28.208602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:28.209417 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:28.210053 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:28.210988 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:28.211794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:28.212450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:28.375893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:28.385263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b0b3977a-cd4c-439e-8bad-5423d879d872 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1554 microversion: 2.1 time: 0.193252 Oct 20 14:46:28.387385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 355/724] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:28 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:28.601060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-26052a32-99aa-4eec-9f1e-8b9ed7e2e29a req-5e87deeb-c950-4b57-9ce5-a98540d1c9cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "396b3353-8853-4ac0-abcd-98f55e471826", "name": "network-vif-deleted", "tag": "7737f129-fde2-4080-b32b-e42c5e55b1b7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:28.615005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-26052a32-99aa-4eec-9f1e-8b9ed7e2e29a req-5e87deeb-c950-4b57-9ce5-a98540d1c9cf service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:28.616472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-26052a32-99aa-4eec-9f1e-8b9ed7e2e29a req-5e87deeb-c950-4b57-9ce5-a98540d1c9cf service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:28.617104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-26052a32-99aa-4eec-9f1e-8b9ed7e2e29a req-5e87deeb-c950-4b57-9ce5-a98540d1c9cf service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:28.631815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-26052a32-99aa-4eec-9f1e-8b9ed7e2e29a req-5e87deeb-c950-4b57-9ce5-a98540d1c9cf service nova] Creating event network-vif-deleted:7737f129-fde2-4080-b32b-e42c5e55b1b7 for instance 396b3353-8853-4ac0-abcd-98f55e471826 on hv-cinder-77923 Oct 20 14:46:28.638632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-26052a32-99aa-4eec-9f1e-8b9ed7e2e29a req-5e87deeb-c950-4b57-9ce5-a98540d1c9cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041253 Oct 20 14:46:28.639529 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 370/725] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:28.727479 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:28.729784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:28.741179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:28.741674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:28.742115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:28.742814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:28.743263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:28.743687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:28.910654 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:28.919867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:28.921740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:28.923166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-66abda99-d07d-47b6-97f0-2f1bc32afa7a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.205547 Oct 20 14:46:28.923951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 356/726] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:28 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:29.410648 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:29.414761 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:29.423138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:29.424411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:29.425137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:29.426017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:29.426534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:29.427019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:29.484326 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:29.485172 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:29.485777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:29.486427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lazy-loading 'fault' on Instance uuid 396b3353-8853-4ac0-abcd-98f55e471826 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:46:29.552508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '95515d28733f4c7e837eee5673346901', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'adc778cfb32049d5844da08c78ba014a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:29.562410 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1d1cfa2f-8d85-4250-b11c-52a7db080c97 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 200 len: 1349 microversion: 2.1 time: 0.156010 Oct 20 14:46:29.573121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 371/727] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:29 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 1349 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:29.954041 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:29.954929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:29.961409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:29.961887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:29.962316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:29.963003 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:29.963450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:29.963872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:30.112107 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:30.120589 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:30.122035 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:30.123424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6d949d22-48eb-463d-9f4c-58e3413a25cb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.173875 Oct 20 14:46:30.123993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 357/728] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:29 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:46:30.588106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:30.588767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] [instance: 396b3353-8853-4ac0-abcd-98f55e471826] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:30.596511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:30.597093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:30.597601 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:30.598376 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:30.598918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:30.599409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:30.616585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] HTTP exception thrown: Instance 396b3353-8853-4ac0-abcd-98f55e471826 could not be found. Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Request method failure captured: Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 HTTP/1.1 Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV6u9CFw_PEHTzXdS0qwwvw5YkXJcSJKxdYGXPjDORRL_ODpWORPO5jV2XhxyWLcKpHRHGNenm-YSTVhKWfPiCmI5kttRAXyl0PeWrOZacYRlcuobKB263Dv6u23RcvRFHD6bJj0qMrKiZMVixL-UJPDTzUWqCOld1nsNmu01cRytns Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: adc778cfb32049d5844da08c78ba014a Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-TestMinimumBasicScenario-1366829823 Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:46:30.618279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_adc778cfb32049d5844da08c78ba014a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/adc778cfb32049d5844da08c78ba014a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adc778cfb32049d5844da08c78ba014a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/adc778cfb32049d5844da08c78ba014a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-TestMinimumBasicScenario-1366829823 Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: adc778cfb32049d5844da08c78ba014a Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1366829823 Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-TestMinimumBasicScenario-1366829823-project Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 95515d28733f4c7e837eee5673346901 Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-TestMinimumBasicScenario-1366829823-project Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 396b3353-8853-4ac0-abcd-98f55e471826 could not be found. Oct 20 14:46:30.619868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '396b3353-8853-4ac0-abcd-98f55e471826'} Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 396b3353-8853-4ac0-abcd-98f55e471826 could not be found. Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:46:30.620738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 396b3353-8853-4ac0-abcd-98f55e471826 could not be found. Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 396b3353-8853-4ac0-abcd-98f55e471826 could not be found. Oct 20 14:46:30.622239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:46:30.624168 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Returning 404 to user: Instance 396b3353-8853-4ac0-abcd-98f55e471826 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:46:30.624168 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d1633a21-ce98-4ad8-abcd-e46491d4fa65 tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826" status: 404 len: 111 microversion: 2.1 time: 0.035589 Oct 20 14:46:30.624168 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 372/729] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:30 2022] GET /compute/v2.1/servers/396b3353-8853-4ac0-abcd-98f55e471826 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:46:30.630451 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c24a9112-c3fd-4043-a2e1-cf222a9f021c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] Calling method '.version_select at 0x7f6344d239d0>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:30.656986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c24a9112-c3fd-4043-a2e1-cf222a9f021c tempest-TestMinimumBasicScenario-1366829823 tempest-TestMinimumBasicScenario-1366829823-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1236050222" status: 202 len: 0 microversion: 2.1 time: 0.030607 Oct 20 14:46:30.657574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 358/730] 10.222.0.13 () {58 vars in 1272 bytes} [Thu Oct 20 14:46:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1236050222 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:46:31.149570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:31.150182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:31.157256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:31.157735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:31.158227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:31.158945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:31.159392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:31.159815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:31.380917 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:31.389894 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:31.391334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:31.392742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-db142b10-de4a-4057-8542-d26e7bdd947b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1740 microversion: 2.20 time: 0.247137 Oct 20 14:46:31.393302 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 373/731] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:31 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1740 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:32.420286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:32.421032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:32.427453 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:32.427941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:32.428400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:32.429109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:32.429720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:32.430144 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:32.770825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:32.774554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:32.782282 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:32.783876 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:32.785345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-df198d80-52e9-4bce-9e0c-ef7d19b7ca3a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1722 microversion: 2.20 time: 0.370100 Oct 20 14:46:32.785914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 359/732] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:32 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1722 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:33.814535 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:33.815284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:33.823027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:33.824138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:33.824771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:33.825930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:33.827137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:33.827740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:34.032549 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:34.041218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:34.043138 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:34.044450 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-39f31e5e-a09c-4425-b943-59a64eec9298 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1722 microversion: 2.20 time: 0.235945 Oct 20 14:46:34.045507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 374/733] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:33 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:35.071101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:35.071726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:35.078585 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:35.079072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:35.079706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:35.080609 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:35.081068 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:35.081499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:35.284399 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:35.292630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:35.294630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:35.295975 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d93a5103-2f8f-4ffe-895e-6a5a3883bc0b tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1665 microversion: 2.20 time: 0.228920 Oct 20 14:46:35.296598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 360/734] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:35 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1665 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:35.321108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0cc50763-bf40-49da-bcce-d2a424c35fe3"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:35.323550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:35.330270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:35.330844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:35.331275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:35.331965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:35.332437 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:35.332857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:35.675036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-53ea108b-c085-46fa-be47-c97b492d7b06 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.357382 Oct 20 14:46:35.675853 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 375/735] 10.222.0.13 () {62 vars in 1364 bytes} [Thu Oct 20 14:46:35 2022] POST /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-volume_attachments => generated 188 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 20 14:46:35.826209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:35.826969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:35.833850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:35.834626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:35.835158 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:35.835942 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:35.836504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:35.837011 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:36.127830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ca78d89a-67d2-49bf-81fe-88ab011f6284 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-volume_attachments/0cc50763-bf40-49da-bcce-d2a424c35fe3" status: 202 len: 0 microversion: 2.20 time: 0.307082 Oct 20 14:46:36.130140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 361/736] 10.222.0.13 () {60 vars in 1457 bytes} [Thu Oct 20 14:46:35 2022] DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-volume_attachments/0cc50763-bf40-49da-bcce-d2a424c35fe3 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:46:36.204091 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:36.204960 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:36.212126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:36.212911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:36.213502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:36.214370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:36.214815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:36.215564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:36.252099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125811) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 14:46:36.344933 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0724e21f-5418-4d0b-bc1b-7cafa32b0397 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "POST /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/action" status: 202 len: 0 microversion: 2.20 time: 0.144923 Oct 20 14:46:36.345598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 376/737] 10.222.0.13 () {62 vars in 1319 bytes} [Thu Oct 20 14:46:36 2022] POST /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/action => generated 0 bytes in 146 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:46:36.353769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:36.354536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:36.365591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:36.367602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:36.368224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:36.369178 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:36.369795 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:36.370555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:36.765911 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-ab228ad1-4fc5-4dfb-b5b6-9183bf892616 req-7264a123-eb9e-4ea8-8942-970e85734544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "name": "network-vif-unplugged", "status": "completed", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:36.779011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-ab228ad1-4fc5-4dfb-b5b6-9183bf892616 req-7264a123-eb9e-4ea8-8942-970e85734544 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:36.779909 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-ab228ad1-4fc5-4dfb-b5b6-9183bf892616 req-7264a123-eb9e-4ea8-8942-970e85734544 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:36.780619 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-ab228ad1-4fc5-4dfb-b5b6-9183bf892616 req-7264a123-eb9e-4ea8-8942-970e85734544 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:36.795758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.compute.server_external_events [req-ab228ad1-4fc5-4dfb-b5b6-9183bf892616 req-7264a123-eb9e-4ea8-8942-970e85734544 service nova] Unable to find a host for instance 51cb557d-d0f7-4b32-bc95-04812c917244. Dropping event network-vif-unplugged {{(pid=125811) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 20 14:46:36.798778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-ab228ad1-4fc5-4dfb-b5b6-9183bf892616 req-7264a123-eb9e-4ea8-8942-970e85734544 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.121868 Oct 20 14:46:36.799900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 377/738] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:36 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 125 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Oct 20 14:46:36.924057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:36.932918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:36.934354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:36.936079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-afbd0c1f-5cda-4387-88b6-ab4e406490e9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1673 microversion: 2.20 time: 0.586174 Oct 20 14:46:36.936682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 362/739] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:36 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1673 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:37.962107 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:37.962785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:37.970312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:37.970865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:37.971498 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:37.972623 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:37.973211 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:37.973787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:38.109407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:38.113043 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=6,nova_cell1:INSERT=5 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:38.124330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:38.125850 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:38.127037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-12706627-24d8-4b0d-834c-39522e573557 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.169022 Oct 20 14:46:38.127961 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 378/740] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:37 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:39.152083 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:39.152899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:39.161353 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:39.161857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:39.162616 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:39.163540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:39.164031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:39.164483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:39.319887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:39.332549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:39.332549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:39.340450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-90d69bb5-e067-4705-9354-7b1c16ffdc16 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.192036 Oct 20 14:46:39.341220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 363/741] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:39 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:40.367656 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:40.371423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:40.380558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:40.381046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:40.381471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:40.382372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:40.382815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:40.383396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:40.579284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:40.595091 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:40.597007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:40.606104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a2cbc852-3199-48d8-b165-35e979e33495 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.242963 Oct 20 14:46:40.611129 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 379/742] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:40 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:41.641611 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:41.642345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:41.649771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:41.650495 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:41.651098 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:41.651811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:41.652263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:41.652752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:41.947748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:41.948848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:41.956496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:41.957284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:41.957887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:41.958747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:41.959353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:41.960095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:42.069847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lazy-loading 'services' on Instance uuid 824af68b-a192-4a4d-8058-1ab7086ef986 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:46:42.157521 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-137b3242-4f72-4661-81fd-a634ebca0b21 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments/e4c84491-d7db-47b0-8b1b-dd6351f54af3" status: 202 len: 0 microversion: 2.1 time: 0.213561 Oct 20 14:46:42.158282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 380/743] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:46:41 2022] DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments/e4c84491-d7db-47b0-8b1b-dd6351f54af3 => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 14:46:42.167431 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:42.170152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:42.181444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:42.181937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:42.183082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:42.183787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:42.185316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:42.186025 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:42.202534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:42.218823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:42.223115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:42.229790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d1228929-c07b-4336-9245-fe2ab59ae200 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.593132 Oct 20 14:46:42.230936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 364/744] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:41 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:42.254250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c20a10f0-3830-4bf5-9a50-2cc98c05ec6d tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.090739 Oct 20 14:46:42.258666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 381/745] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:42 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:46:43.260714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:43.261854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:43.269144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:43.271901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:43.289811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:43.297233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:43.298222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:43.298874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:43.299496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:43.300905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:43.301121 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:43.301973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:43.302580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:43.303191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:43.303796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:43.308044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:43.407179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-808c6245-0be2-423a-8917-9986684b6c83 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.142570 Oct 20 14:46:43.421139 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 382/746] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:43 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:43.629665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:43.644902 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:43.646713 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:43.648135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d70e4b48-2563-4817-a135-ac626645e40a tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.391952 Oct 20 14:46:43.649554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 365/747] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:43 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:44.430338 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:44.432528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:44.441812 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:44.442520 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:44.443108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:44.443996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:44.444633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:44.445397 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:44.517462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-90ab7c20-e6fc-4ea3-b93c-38234c97a8f0 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091839 Oct 20 14:46:44.518326 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 383/748] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:44 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:44.678921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:44.679465 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:44.695997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:44.696768 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:44.701444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:44.703123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:44.703604 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:44.704046 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:45.030465 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:45.057583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:45.059775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:45.061034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b2b5acbe-621a-452f-9591-29a553c60d35 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.386045 Oct 20 14:46:45.073655 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 366/749] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:44 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:45.530695 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:45.536985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:45.561148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:45.562019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:45.562693 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:45.563824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:45.564638 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:45.565217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:45.614381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ef49cf79-94a6-44d0-b186-0b5044fbc145 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087785 Oct 20 14:46:45.615287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 384/750] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:45 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:46.098979 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:46.100472 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:46.110064 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:46.113246 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:46.114117 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:46.114828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:46.115834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:46.116615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:46.117430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:46.352286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:46.362394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:46.370303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:46.371616 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f9deeb3a-9c51-4286-a74f-4cebd0cdf8e8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.277553 Oct 20 14:46:46.372109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 367/751] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:46 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:46.635705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:46.640178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:46.657768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:46.659452 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:46.660087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:46.665731 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:46.666414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:46.666867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:46.718101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-de002b05-c609-46c5-984d-8c7da4ffad96 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093419 Oct 20 14:46:46.724155 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 385/752] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:46 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:47.403434 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:47.404834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:47.414894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:47.415378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:47.418167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:47.419724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:47.429304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:47.429771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:47.721771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:47.732209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:47.734433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:47.750398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:47.751471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:47.759945 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:47.763964 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ae3a2486-cbe1-498f-9f25-728e6532b804 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.365838 Oct 20 14:46:47.781773 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 368/753] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:47 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:47.783435 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:47.793094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:47.793921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:47.795598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:47.796083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:47.796548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:47.862838 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d7d81c3a-b7d1-4329-803e-ef42a4f714e3 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.136082 Oct 20 14:46:47.868266 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 386/754] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:47 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:48.802434 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:48.803689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:48.811429 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:48.811914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:48.812389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:48.813149 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:48.813602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:48.814022 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:48.876630 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:48.878844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:48.885832 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:48.886548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:48.887205 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:48.888426 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:48.889170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:48.889740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:48.929919 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e3430a08-bca4-414f-98fa-61c1d478d7ec tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058486 Oct 20 14:46:48.935852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 387/755] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:48 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:49.039814 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:49.048232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:49.050251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:49.051413 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a795080e-a7e3-4266-b188-8bf8643a9737 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.252842 Oct 20 14:46:49.052133 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 369/756] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:48 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:49.943054 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:49.945243 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:49.959335 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:49.959825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:49.960250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:49.961050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:49.961504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:49.961914 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:50.033620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3bb958ef-73a9-4a68-9a24-e3522c89cc29 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.094357 Oct 20 14:46:50.038356 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 388/757] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:49 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:50.078939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:50.079596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:50.098143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:50.098645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:50.099081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:50.099797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:50.100251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:50.100708 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:50.387765 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:50.399633 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:50.402360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:50.405854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-80c950d4-8a81-4dfd-872a-d071150b232d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.331634 Oct 20 14:46:50.409115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 370/758] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:50 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:51.046774 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:51.049273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:51.056380 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:51.057014 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:51.057575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:51.058601 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:51.059357 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:51.060075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:51.110231 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6a54a644-9b61-4c90-8c45-12bb23f2d498 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066355 Oct 20 14:46:51.116802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 389/759] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:51 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:51.435244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:51.435966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:51.442698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:51.443285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:51.443798 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:51.444610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:51.445304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:51.445885 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:51.655828 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:51.665333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:51.666769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:51.669953 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d0237a53-ca98-4805-a44f-b2e42c5c0999 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.240851 Oct 20 14:46:51.672428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 371/760] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:51 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:51.938339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3161952d-6418-4a17-a207-5f3ab14f8901 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Action: 'create', calling method: .version_select at 0x7f6344c6c0d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-711448910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKjZbnztEocJJtJ9JrQF74cQJ8tzhE0ybrrUO2ffqwqc8d6VzT6DR6k8IgXhgftMGOruiXkoRo17Rohn+6jYX8lVi3HJ5WG3hSLpgyWot9Z/b5BLl0u3glcPF2y6ip1vwA=="}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:51.954979 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-3161952d-6418-4a17-a207-5f3ab14f8901 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Getting quotas for project 370ff2b623ce4dfc992a266bd41ee51e. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:46:51.958827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-3161952d-6418-4a17-a207-5f3ab14f8901 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Getting quotas for user d7383d936b3544ccb9093a3beeb5cbd3 and project 370ff2b623ce4dfc992a266bd41ee51e. Resources: {'key_pairs'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:46:51.983440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3161952d-6418-4a17-a207-5f3ab14f8901 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.216517 Oct 20 14:46:51.984034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 390/761] 10.222.0.13 () {60 vars in 1159 bytes} [Thu Oct 20 14:46:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:52.126136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:52.129600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:52.139190 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.139692 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.140214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.140963 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.141413 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.141834 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.174342 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-31641e5d-933d-4055-8ea6-f2f442afbba9 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054556 Oct 20 14:46:52.174912 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 372/762] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:46:52 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 14:46:52.263235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:52.263235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:52.269879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.270435 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.270932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.271704 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.272238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.272746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.301079 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:46:52.388975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-37e18d0c-faaa-4eb8-8260-bccedd0fa1f6 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 204 len: 0 microversion: 2.1 time: 0.131663 Oct 20 14:46:52.390279 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 391/763] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:46:52 2022] DELETE /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:46:52.399132 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:52.399848 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:52.407061 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.407622 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.408123 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.408940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.409473 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.409949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.561929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:52.570714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3ddcfcc4-2e3f-4fc4-bae1-5941b1ee1b47 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1691 microversion: 2.1 time: 0.175970 Oct 20 14:46:52.571298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 373/764] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:52 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1691 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:52.699857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:52.700710 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:52.708072 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.708827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.709250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.709977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:52.710607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:52.711248 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:52.881798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:52.892514 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:52.893949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:52.895298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-96999913-6b61-4d88-ad39-386ad72cc1fb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.202204 Oct 20 14:46:52.895854 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 392/765] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:52 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 20 14:46:53.599597 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:53.600212 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:53.607997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:53.608520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:53.608956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:53.609665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:53.610119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:53.610541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:53.614702 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:53.759672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:53.768467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3d02ef4c-b783-45b1-b8db-9ab364ad8cdb tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1691 microversion: 2.1 time: 0.172745 Oct 20 14:46:53.769043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 374/766] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:53 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1691 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:53.923093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:53.923737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:53.931376 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:53.931856 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:53.932332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:53.933118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:53.933588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:53.934090 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:54.080429 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:54.088792 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:54.091304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:54.092515 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c27602eb-9960-4cd2-b0c8-f7ed156d0ab8 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.174888 Oct 20 14:46:54.093078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 393/767] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:53 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:54.633676 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:54.634236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:54.641182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:54.641727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:54.642305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:54.643012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:54.643467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:54.643896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:54.668815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-facaa2f8-e016-4ed5-8450-2868ef73d3d8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/ips" status: 200 len: 146 microversion: 2.1 time: 0.180056 Oct 20 14:46:54.669381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 375/768] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:46:54 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/ips => generated 146 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:54.794418 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:54.795382 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:54.801289 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:54.801996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:54.802423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:54.803108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:54.803716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:54.804156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:54.809678 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:46:54.999598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-1ab21f96-67ac-4f59-8bd3-d79aea19f57f req-c02f673e-f8a7-47f8-b981-3d4fddbb4d73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "name": "network-vif-plugged", "status": "completed", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:55.017722 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1ab21f96-67ac-4f59-8bd3-d79aea19f57f req-c02f673e-f8a7-47f8-b981-3d4fddbb4d73 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:55.018879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1ab21f96-67ac-4f59-8bd3-d79aea19f57f req-c02f673e-f8a7-47f8-b981-3d4fddbb4d73 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:55.019676 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1ab21f96-67ac-4f59-8bd3-d79aea19f57f req-c02f673e-f8a7-47f8-b981-3d4fddbb4d73 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:55.037072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-1ab21f96-67ac-4f59-8bd3-d79aea19f57f req-c02f673e-f8a7-47f8-b981-3d4fddbb4d73 service nova] Creating event network-vif-plugged:20cf55bd-3d91-4bda-9c08-8252ca71c6a7 for instance 51cb557d-d0f7-4b32-bc95-04812c917244 on hv-cinder-77923 Oct 20 14:46:55.043790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-1ab21f96-67ac-4f59-8bd3-d79aea19f57f req-c02f673e-f8a7-47f8-b981-3d4fddbb4d73 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048684 Oct 20 14:46:55.045375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 376/769] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:55.121605 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:55.122903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:55.123904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:55.133586 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:55.134251 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:55.134685 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:55.135590 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:55.136044 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:55.136658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:55.140714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-53c7f802-536d-4eb7-b85f-dd69b8c45782 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1691 microversion: 2.1 time: 0.350108 Oct 20 14:46:55.141703 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 394/770] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:54 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1691 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:55.288711 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:55.298342 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:55.299820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:55.301044 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ce34d8a0-8070-437f-8b67-a5b501e2b93f tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.185503 Oct 20 14:46:55.301611 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 377/771] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:55 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:56.145798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e727b350-82d3-4bc4-b089-b7cde68dfd80"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:56.148252 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:56.156421 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:56.156918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:56.157360 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:56.158060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:56.158512 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:56.158933 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:56.169173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:56.169794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:56.176738 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:56.177554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:56.178244 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:56.179273 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:56.179943 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:56.180384 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:56.345519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:56.363177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4e13f5f8-74cc-4e7a-a219-f527c5a79c03 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1691 microversion: 2.1 time: 0.197809 Oct 20 14:46:56.363701 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 378/772] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:56 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:56.368558 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:56.369418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:56.376252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:56.377056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:56.378008 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:56.379626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:56.380374 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:56.381322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:56.617921 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:56.631192 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:56.633364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:56.635067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-85916b6c-5a23-42d6-8431-2d39cc931e57 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.270424 Oct 20 14:46:56.635919 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 379/773] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:56 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:56.651560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-762d11a3-18e9-474d-b563-8c899cd3d5dc tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.509536 Oct 20 14:46:56.659863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 395/774] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:46:56 2022] POST /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments => generated 194 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:46:57.389148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:57.390753 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:57.398142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:57.398640 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:57.399069 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:57.399771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:57.400233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:57.400881 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:57.471178 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-2e87c45c-efa2-40c2-9118-2f8aa4b5e65a req-9faf4769-c5cd-47c7-bcde-d18a3e5971ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "824af68b-a192-4a4d-8058-1ab7086ef986", "name": "network-vif-deleted", "tag": "d15efa7b-2d55-44cf-a379-eaaae6f4f141"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:46:57.481538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:57.490504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e6fc44b6-0cb5-42d3-b06a-872411d78378 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1623 microversion: 2.1 time: 0.106714 Oct 20 14:46:57.493199 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2e87c45c-efa2-40c2-9118-2f8aa4b5e65a req-9faf4769-c5cd-47c7-bcde-d18a3e5971ce service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:57.493687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2e87c45c-efa2-40c2-9118-2f8aa4b5e65a req-9faf4769-c5cd-47c7-bcde-d18a3e5971ce service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:57.494116 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2e87c45c-efa2-40c2-9118-2f8aa4b5e65a req-9faf4769-c5cd-47c7-bcde-d18a3e5971ce service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:57.512371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 396/775] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:57 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1623 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:46:57.526971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-2e87c45c-efa2-40c2-9118-2f8aa4b5e65a req-9faf4769-c5cd-47c7-bcde-d18a3e5971ce service nova] Creating event network-vif-deleted:d15efa7b-2d55-44cf-a379-eaaae6f4f141 for instance 824af68b-a192-4a4d-8058-1ab7086ef986 on hv-cinder-77923 Oct 20 14:46:57.534274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-2e87c45c-efa2-40c2-9118-2f8aa4b5e65a req-9faf4769-c5cd-47c7-bcde-d18a3e5971ce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168296 Oct 20 14:46:57.537936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 380/776] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:46:57.664034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:57.664658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:57.672323 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:57.672945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:57.673443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:57.674197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:57.674709 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:57.675190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:57.833018 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:57.842014 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:57.843469 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:57.844728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9806a330-c923-4094-bb29-87e5d52d5c64 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.184491 Oct 20 14:46:57.845298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 397/777] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:57 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:58.523007 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:58.526969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:58.535394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:58.536025 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:58.536676 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:58.538033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:58.538843 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:58.539473 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:58.596811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:58.597349 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:58.598520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:58.598520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lazy-loading 'fault' on Instance uuid 824af68b-a192-4a4d-8058-1ab7086ef986 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:46:58.650698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:58.669207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-182ed5a4-0e65-4df1-840a-6e238e71d4be tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 200 len: 1336 microversion: 2.1 time: 0.150808 Oct 20 14:46:58.669818 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 381/778] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:58 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 1336 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:46:58.879556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:58.880195 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:58.888615 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:58.889106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:58.889849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:58.890557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:58.891010 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:58.904420 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:59.037951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:59.047098 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:59.048570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:46:59.049745 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f8bda160-a9f4-4162-9c57-7f7564ce6bf4 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1731 microversion: 2.20 time: 0.176718 Oct 20 14:46:59.050307 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 398/779] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:46:58 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1731 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:46:59.693593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:59.694207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 824af68b-a192-4a4d-8058-1ab7086ef986] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:46:59.700664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:59.701141 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:59.701578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:59.702267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:46:59.702725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:46:59.703229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:46:59.717394 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] HTTP exception thrown: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 could not be found. Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Request method failure captured: Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 HTTP/1.1 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV5TjoJLYhDXw1bj-3kscJgEH0wdlXR8gFBrluD-CiLj182QNmPe2U_X6kVdriE3DOCvvlh9PfylUAUezoqa8Gwnw10EGesOKq8iAZxHLj9EqZ9Io1PzTPzKIHMKpeC9DtPEU2wJxlLlfTGKNaWH_AR0ABT8P-fZ1C7uZWTH3U-jxg0 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:46:59.719669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: ae94a3ece5f644c6893589a1df84d1c6 Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 could not be found. Oct 20 14:46:59.721615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '824af68b-a192-4a4d-8058-1ab7086ef986'} Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 could not be found. Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:46:59.722506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 could not be found. Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 could not be found. Oct 20 14:46:59.723978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:46:59.725314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Returning 404 to user: Instance 824af68b-a192-4a4d-8058-1ab7086ef986 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:46:59.725314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a6c90ce2-cae6-42b4-a5b4-1388b87b5135 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986" status: 404 len: 111 microversion: 2.1 time: 0.031434 Oct 20 14:46:59.725314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 382/780] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:46:59 2022] GET /compute/v2.1/servers/824af68b-a192-4a4d-8058-1ab7086ef986 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:46:59.730081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-813b2310-33a2-4a9e-9241-e8ce35753171 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '.version_select at 0x7f6344c6cf70>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:46:59.748320 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-813b2310-33a2-4a9e-9241-e8ce35753171 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215214718" status: 202 len: 0 microversion: 2.1 time: 0.022216 Oct 20 14:46:59.748878 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 399/781] 10.222.0.13 () {58 vars in 1221 bytes} [Thu Oct 20 14:46:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1215214718 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:47:00.075082 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:00.075687 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:00.083423 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:00.083918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:00.089751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:00.090620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:00.091100 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:00.091532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:00.234698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:00.242723 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:00.244298 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:00.245511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5dafbd5a-eeb8-49bb-b23f-4c28c449d9d6 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1718 microversion: 2.20 time: 0.174367 Oct 20 14:47:00.246063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 383/782] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:00 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1718 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:47:02.644333 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=4 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:02.648721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:02.649368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:02.656967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:02.657461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:02.657897 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:02.658601 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:02.659054 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:02.659476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:02.684849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:47:02.761494 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b8aa12b4-0ad9-4293-936b-6eacd4461034 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 204 len: 0 microversion: 2.1 time: 0.118266 Oct 20 14:47:02.762080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 400/783] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:02 2022] DELETE /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:47:02.770712 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:02.771323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:02.777947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:02.778446 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:02.778971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:02.779879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:02.780367 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:02.781104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:02.919913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:02.927561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-09277380-2bfc-4c8b-9e16-a16c0802e07c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1508 microversion: 2.1 time: 0.160660 Oct 20 14:47:02.928125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 384/784] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:02 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:03.953671 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:03.954373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:03.961341 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:03.961845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:03.962326 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:03.963009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:03.963472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:03.963901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:04.094738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:04.102322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9e4106dc-6938-452a-8490-df7839da9e1c tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1508 microversion: 2.1 time: 0.153395 Oct 20 14:47:04.102887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 401/785] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:03 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:05.126215 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:05.126840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:05.133532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:05.133958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:05.134395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:05.135082 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:05.135535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:05.135954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:05.276514 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:05.284385 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-cf2f468a-d58d-456f-b10d-7a5d19ae1209 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1508 microversion: 2.1 time: 0.162604 Oct 20 14:47:05.284951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 385/786] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:05 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:06.307235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:06.308110 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:06.316869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.317359 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.323157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.323950 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.324642 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.325079 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.448899 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:06.451156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:06.457511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.458001 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.458437 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.459141 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.459594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.460202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.476023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:06.486534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c2572d32-24b5-43fb-a421-66ec387c31ce tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 200 len: 1508 microversion: 2.1 time: 0.183096 Oct 20 14:47:06.501591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-728ea361-d3fc-40cd-a25d-df17a55132d5 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056560 Oct 20 14:47:06.501820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 402/787] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:06 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 1508 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:06.502382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 386/788] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:06 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:47:06.510162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:06.510664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:06.513430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:06.514038 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:06.517870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.518538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.519210 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.520180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.520317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.520827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.520962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.521270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.521396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.521972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.522426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.522850 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.552379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d5b6fce1-050a-4ace-bb50-bd0ea5a5101f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/ips" status: 200 len: 150 microversion: 2.1 time: 0.048276 Oct 20 14:47:06.552379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 403/789] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:47:06 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:06.561131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7c1e00f6-8731-41cf-b3f6-4030f2d12350 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/e727b350-82d3-4bc4-b089-b7cde68dfd80" status: 200 len: 194 microversion: 2.1 time: 0.051835 Oct 20 14:47:06.562528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 387/790] 10.222.0.13 () {58 vars in 1413 bytes} [Thu Oct 20 14:47:06 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/e727b350-82d3-4bc4-b089-b7cde68dfd80 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:06.649826 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-477f8a54-c7ec-4217-a451-a8dde145d017 req-4f169411-164a-40ca-b595-c0d38acea5ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b5bcc045-0b0b-4f4a-991d-d40547da9027", "name": "network-vif-deleted", "tag": "6f0acfab-47c9-46e0-a4ca-c0ae37a57386"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:06.661491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-477f8a54-c7ec-4217-a451-a8dde145d017 req-4f169411-164a-40ca-b595-c0d38acea5ff service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:06.662361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-477f8a54-c7ec-4217-a451-a8dde145d017 req-4f169411-164a-40ca-b595-c0d38acea5ff service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:06.662949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-477f8a54-c7ec-4217-a451-a8dde145d017 req-4f169411-164a-40ca-b595-c0d38acea5ff service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:06.676454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-477f8a54-c7ec-4217-a451-a8dde145d017 req-4f169411-164a-40ca-b595-c0d38acea5ff service nova] Creating event network-vif-deleted:6f0acfab-47c9-46e0-a4ca-c0ae37a57386 for instance b5bcc045-0b0b-4f4a-991d-d40547da9027 on hv-cinder-77923 Oct 20 14:47:06.683761 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-477f8a54-c7ec-4217-a451-a8dde145d017 req-4f169411-164a-40ca-b595-c0d38acea5ff service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037739 Oct 20 14:47:06.684936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 404/791] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:07.515079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:07.515966 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: b5bcc045-0b0b-4f4a-991d-d40547da9027] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:07.523309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:07.523905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:07.524478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:07.525136 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:07.525645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:07.526099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:07.542121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] HTTP exception thrown: Instance b5bcc045-0b0b-4f4a-991d-d40547da9027 could not be found. Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Request method failure captured: Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 HTTP/1.1 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV5TjoJLYhDXw1bj-3kscJgEH0wdlXR8gFBrluD-CiLj182QNmPe2U_X6kVdriE3DOCvvlh9PfylUAUezoqa8Gwnw10EGesOKq8iAZxHLj9EqZ9Io1PzTPzKIHMKpeC9DtPEU2wJxlLlfTGKNaWH_AR0ABT8P-fZ1C7uZWTH3U-jxg0 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:07.543674 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: ae94a3ece5f644c6893589a1df84d1c6 Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance b5bcc045-0b0b-4f4a-991d-d40547da9027 could not be found. Oct 20 14:47:07.545084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'b5bcc045-0b0b-4f4a-991d-d40547da9027'} Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b5bcc045-0b0b-4f4a-991d-d40547da9027 could not be found. Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:07.545852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b5bcc045-0b0b-4f4a-991d-d40547da9027 could not be found. Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b5bcc045-0b0b-4f4a-991d-d40547da9027 could not be found. Oct 20 14:47:07.547601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:07.549488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Returning 404 to user: Instance b5bcc045-0b0b-4f4a-991d-d40547da9027 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:07.549488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-89df2e89-254c-476a-8e18-2aa5417f7e95 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027" status: 404 len: 111 microversion: 2.1 time: 0.034018 Oct 20 14:47:07.549488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 388/792] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:07 2022] GET /compute/v2.1/servers/b5bcc045-0b0b-4f4a-991d-d40547da9027 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:07.554929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:07.555705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:07.562478 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:07.562972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:07.563409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:07.564104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:07.564592 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:07.565020 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:07.590443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:47:07.670876 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-096a3ae0-f813-45ae-b707-ec6ab1962f61 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 204 len: 0 microversion: 2.1 time: 0.119721 Oct 20 14:47:07.671782 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 405/793] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:07 2022] DELETE /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:47:07.680093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:07.681093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:07.686928 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:07.687588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:07.688217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:07.688961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:07.689420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:07.689848 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:07.820228 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:07.828290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d6755460-1426-499d-89da-9e6bb762d2da tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.151874 Oct 20 14:47:07.828881 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 389/794] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:07 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:07.997310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d078144-b9b7-4c5b-aeb0-8a3819056305"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:08.000244 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:08.006136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:08.006607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:08.007209 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:08.007900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:08.008448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:08.008806 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:08.019030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f220246-f1e2-44c7-957d-a48261b9c75d"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:08.021575 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:08.027700 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:08.028190 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:08.028659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:08.029358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:08.029813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:08.030261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:11.174179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:11.183994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d830da8f-7e63-452a-b463-f49a7f2a7232 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "POST /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.190772 Oct 20 14:47:11.184627 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 406/795] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:47:07 2022] POST /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments => generated 194 bytes in 3192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:11.189999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a5e86631-0343-4cc5-987a-d1fb8a664731 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "POST /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.175450 Oct 20 14:47:11.190866 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 390/796] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:47:08 2022] POST /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments => generated 194 bytes in 3178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:47:11.192454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:11.193760 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:11.195690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-814182698", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-711448910", "security_groups": [{"name": "tempest-secgroup-smoke-339419520"}], "networks": [{"uuid": "97a278cd-34d3-48f4-b47e-9e6a7ff3c6e7"}], "block_device_mapping_v2": [{"uuid": "cbd9b4b2-e2a7-48f1-af1a-73525133f60c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:11.204529 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:11.205105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:11.205892 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:11.206797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:11.207681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:11.208316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:11.387428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] validate_networks() for [('97a278cd-34d3-48f4-b47e-9e6a7ff3c6e7', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:47:11.480273 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:11.488966 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a892065c-cb86-4030-adfd-d19855dd56df tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1522 microversion: 2.1 time: 0.303144 Oct 20 14:47:11.490086 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 407/797] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:11 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:11.892253 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:47:11.892942 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:47:11.893414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:47:11.893821 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:47:11.894233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:47:11.902929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:11.903407 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:11.903838 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:11.904593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:11.905050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:11.905471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:11.922983 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Getting quotas for project 370ff2b623ce4dfc992a266bd41ee51e. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:47:11.926981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Getting quotas for user d7383d936b3544ccb9093a3beeb5cbd3 and project 370ff2b623ce4dfc992a266bd41ee51e. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:47:11.987717 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:47:11.990095 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='cbd9b4b2-e2a7-48f1-af1a-73525133f60c',volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:47:12.061236 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-f4133004-25ac-4f8a-a7db-0e9b44d5256f req-34c529db-eee4-433d-850a-e41bf2da8887 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a463ded-2b4a-41e5-a54f-bd28d4e92777", "name": "network-vif-deleted", "tag": "accb484b-67f7-4025-9af7-0d63eeee9bd3"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:12.073371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f4133004-25ac-4f8a-a7db-0e9b44d5256f req-34c529db-eee4-433d-850a-e41bf2da8887 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:12.073851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f4133004-25ac-4f8a-a7db-0e9b44d5256f req-34c529db-eee4-433d-850a-e41bf2da8887 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:12.074280 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-f4133004-25ac-4f8a-a7db-0e9b44d5256f req-34c529db-eee4-433d-850a-e41bf2da8887 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:12.087713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-f4133004-25ac-4f8a-a7db-0e9b44d5256f req-34c529db-eee4-433d-850a-e41bf2da8887 service nova] Creating event network-vif-deleted:accb484b-67f7-4025-9af7-0d63eeee9bd3 for instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 on hv-cinder-77923 Oct 20 14:47:12.092809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-f4133004-25ac-4f8a-a7db-0e9b44d5256f req-34c529db-eee4-433d-850a-e41bf2da8887 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036262 Oct 20 14:47:12.093647 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 408/798] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:47:12.143683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-032f6fd9-098c-487d-9b44-6449fc817df6 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.951631 Oct 20 14:47:12.146191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 391/799] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:47:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:47:12.158586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-51faa071-841b-403c-af02-90d2f7ccb19e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:12.159362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-51faa071-841b-403c-af02-90d2f7ccb19e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:12.214598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-51faa071-841b-403c-af02-90d2f7ccb19e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:12.222415 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-51faa071-841b-403c-af02-90d2f7ccb19e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1087 microversion: 2.1 time: 0.068751 Oct 20 14:47:12.222980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 409/800] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:12 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:47:12.513139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:12.513732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:12.529757 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:12.530454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:12.531869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:12.532593 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:12.533070 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:12.533521 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:12.566317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:12.566803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:12.567238 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:12.567681 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lazy-loading 'fault' on Instance uuid 4a463ded-2b4a-41e5-a54f-bd28d4e92777 {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:47:12.570534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:12.615002 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae94a3ece5f644c6893589a1df84d1c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7688b0fbf84b4f4f9c21cb4112ee53b5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:12.622696 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3e9ccf4f-44d1-4221-ad63-f032fc718094 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 200 len: 1311 microversion: 2.1 time: 0.113459 Oct 20 14:47:12.623257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 392/801] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:12 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 1311 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:13.245506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:13.246122 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:13.253621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:13.254103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:13.254538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:13.255272 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:13.255711 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:13.256133 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:13.317658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:13.325157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1562d1c4-1f44-4c98-93fc-15ae1868bc81 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1185 microversion: 2.1 time: 0.083540 Oct 20 14:47:13.325923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 410/802] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:13 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:13.646837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:13.647557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] [instance: 4a463ded-2b4a-41e5-a54f-bd28d4e92777] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:13.655122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:13.655863 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:13.656306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:13.657233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:13.657685 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:13.658188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:13.673105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] HTTP exception thrown: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 could not be found. Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Request method failure captured: Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 HTTP/1.1 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV5TjoJLYhDXw1bj-3kscJgEH0wdlXR8gFBrluD-CiLj182QNmPe2U_X6kVdriE3DOCvvlh9PfylUAUezoqa8Gwnw10EGesOKq8iAZxHLj9EqZ9Io1PzTPzKIHMKpeC9DtPEU2wJxlLlfTGKNaWH_AR0ABT8P-fZ1C7uZWTH3U-jxg0 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:13.674775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7688b0fbf84b4f4f9c21cb4112ee53b5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 7688b0fbf84b4f4f9c21cb4112ee53b5 Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-275745418 Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: ae94a3ece5f644c6893589a1df84d1c6 Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-ServerRescueNegativeTestJSON-275745418-project Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 could not be found. Oct 20 14:47:13.676169 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '4a463ded-2b4a-41e5-a54f-bd28d4e92777'} Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 could not be found. Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:13.676965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 could not be found. Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 could not be found. Oct 20 14:47:13.678174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:13.679358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] Returning 404 to user: Instance 4a463ded-2b4a-41e5-a54f-bd28d4e92777 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:13.679358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0fada32b-c151-4fd5-80a4-11cafa373f68 tempest-ServerRescueNegativeTestJSON-275745418 tempest-ServerRescueNegativeTestJSON-275745418-project] 10.222.0.13 "GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777" status: 404 len: 111 microversion: 2.1 time: 0.033532 Oct 20 14:47:13.679358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 393/803] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:13 2022] GET /compute/v2.1/servers/4a463ded-2b4a-41e5-a54f-bd28d4e92777 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:14.358958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:14.360006 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:14.366602 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:14.367089 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:14.367707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:14.368435 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:14.369048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:14.369620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:14.585310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:14.593534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0d608e62-bff5-4435-a4d7-1a2a049858e5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.246773 Oct 20 14:47:14.595240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 411/804] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:14 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:14.994970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-2bb2ff5d-10bb-4663-b783-8347b5f55016 req-7ad8602e-9988-4fa6-bdc9-2426066fb301 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:15.015104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2bb2ff5d-10bb-4663-b783-8347b5f55016 req-7ad8602e-9988-4fa6-bdc9-2426066fb301 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:15.015598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2bb2ff5d-10bb-4663-b783-8347b5f55016 req-7ad8602e-9988-4fa6-bdc9-2426066fb301 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:15.016527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-2bb2ff5d-10bb-4663-b783-8347b5f55016 req-7ad8602e-9988-4fa6-bdc9-2426066fb301 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:15.030343 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-2bb2ff5d-10bb-4663-b783-8347b5f55016 req-7ad8602e-9988-4fa6-bdc9-2426066fb301 service nova] Creating event network-changed:0526eee3-ed29-410b-be9e-e1916564638c for instance a4919bb2-0fa7-455d-bb9e-55db2807713c on hv-cinder-77923 Oct 20 14:47:15.037728 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-2bb2ff5d-10bb-4663-b783-8347b5f55016 req-7ad8602e-9988-4fa6-bdc9-2426066fb301 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045924 Oct 20 14:47:15.039438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 394/805] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:47:15.619160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:15.620540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:15.628594 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:15.629409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:15.630047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:15.631189 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:15.631972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:15.632818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:15.797689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:15.806946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c4f86688-8685-483f-a7a3-45a1eba0830b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.191268 Oct 20 14:47:15.821663 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 412/806] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:15 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:16.833403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:16.834253 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:16.836284 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:16.842466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:16.842947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:16.843490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:16.844439 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:16.844926 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:16.845354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:16.996533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:17.006051 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a0ec4321-85b1-4e9c-8ffd-ee38d2e59f1b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.178249 Oct 20 14:47:17.006616 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 395/807] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:16 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:18.029022 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:18.029727 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:18.032478 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1,nova_api:UPDATE=3,nova_api:DELETE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:18.038542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:18.039099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:18.039535 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:18.040259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:18.040739 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:18.041284 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:18.182636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:18.191000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f272f093-546c-4042-acb5-a81db76242f4 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.166377 Oct 20 14:47:18.191735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 413/808] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:18 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:18.870682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:18.872903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:18.879473 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:18.879961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:18.880438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:18.881135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:18.881591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:18.882016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:18.914229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-74844aa2-2242-46c5-9c21-e3696e35b80b tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047452 Oct 20 14:47:18.914797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 396/809] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:18 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:19.054951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:19.055481 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:19.061980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:19.062495 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:19.062869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:19.063557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:19.064029 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:19.064453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:19.095963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e91f6356-f992-40ab-a6c9-32b195bd2a92 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/e727b350-82d3-4bc4-b089-b7cde68dfd80" status: 200 len: 194 microversion: 2.1 time: 0.044927 Oct 20 14:47:19.096581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 414/810] 10.222.0.13 () {58 vars in 1413 bytes} [Thu Oct 20 14:47:19 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/e727b350-82d3-4bc4-b089-b7cde68dfd80 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:19.108162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:19.108807 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:19.114740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:19.115224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:19.115654 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:19.116336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:19.116810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:19.117229 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:19.198236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lazy-loading 'services' on Instance uuid d10aa467-2dd1-482b-9e1e-1e1f43e1aafa {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:47:19.214652 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:19.216498 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:19.226676 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:19.227215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:19.228949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:19.228949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:19.228949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:19.229610 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:19.276991 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-522c42a1-b49f-4344-b4f9-1a3152d8e369 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/e727b350-82d3-4bc4-b089-b7cde68dfd80" status: 202 len: 0 microversion: 2.1 time: 0.172728 Oct 20 14:47:19.278168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 397/811] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:47:19 2022] DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/e727b350-82d3-4bc4-b089-b7cde68dfd80 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 14:47:19.393170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:19.400811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-41390a7f-0114-49be-a644-102fba42ffd5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.189900 Oct 20 14:47:19.401369 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 415/812] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:19 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:20.427762 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:20.428527 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:20.434984 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:20.435476 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:20.435911 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:20.436644 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:20.437129 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:20.437552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:20.586159 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:20.597537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-974c91b7-a1d2-41e8-a0b9-60abd6b25ced tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.175871 Oct 20 14:47:20.598487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 398/813] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:20 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:21.619548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:21.620154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:21.626998 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:21.630440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:21.630440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:21.630440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:21.630440 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:21.630846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:21.770714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:21.779020 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7cfa8978-d1de-4d1d-a477-1ff768f3a54e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.163198 Oct 20 14:47:21.779597 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 416/814] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:21 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:22.803005 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:22.803664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:22.806088 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:22.806741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:22.814141 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:22.814627 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:22.815326 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:22.815929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:22.816665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:22.817090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:22.958327 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:22.966291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3e8fa139-4b59-4fe0-904c-38d659d25a73 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.167743 Oct 20 14:47:22.966871 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 399/815] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:22 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:23.991156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:23.991809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:23.993739 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:24.000308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:24.000308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:24.000764 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:24.001467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:24.001926 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:24.002347 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:24.155101 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:24.163633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-edc77734-e950-4dc8-8471-63085b4bb7f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1270 microversion: 2.1 time: 0.175894 Oct 20 14:47:24.164550 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 417/816] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:23 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1270 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:25.190427 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:25.191048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:25.197506 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:25.197991 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:25.198426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:25.199119 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:25.199605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:25.200034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:25.308092 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:25.308661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:25.315794 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:25.316274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:25.316728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:25.317412 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:25.317855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:25.318269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:25.334901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:25.342808 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-41b6d702-dd2c-4a72-8d1f-4c72c41b95f2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.157125 Oct 20 14:47:25.343596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 400/817] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:25 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:25.405775 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'services' on Instance uuid e4caff2a-4143-4567-bb70-554451cc1b0d {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:47:25.481370 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fd896030-bb67-415f-8943-92e0995c888b tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments/3f220246-f1e2-44c7-957d-a48261b9c75d" status: 202 len: 0 microversion: 2.1 time: 0.176913 Oct 20 14:47:25.482039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 418/818] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:47:25 2022] DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments/3f220246-f1e2-44c7-957d-a48261b9c75d => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 14:47:25.490606 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:25.492885 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:25.498713 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:25.499217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:25.499649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:25.501127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:25.501578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:25.501997 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:25.532168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-84a62466-4558-421e-9110-756b317151f0 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044691 Oct 20 14:47:25.532763 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 401/819] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:25 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:26.368493 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:26.369192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:26.376112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.376720 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.377150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.377854 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.378306 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.378720 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.544314 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:26.546645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:26.555296 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.555985 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.556544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.557557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.558074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.558926 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.580459 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:26.591358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-678905be-3137-4ad4-893d-597ad5d87cbf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.227955 Oct 20 14:47:26.592631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 419/820] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:26 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:26.605176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-446b340e-02ca-4f6d-8187-49f03dd5a760 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064752 Oct 20 14:47:26.605952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 402/821] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:26 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:47:26.782500 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:26.783236 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:26.798496 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.798994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.799423 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.800135 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.800619 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.801045 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.830122 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-18eaec1b-471d-4a78-a9ed-14b5bd384b5a tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/6d078144-b9b7-4c5b-aeb0-8a3819056305" status: 200 len: 194 microversion: 2.1 time: 0.055248 Oct 20 14:47:26.830712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 420/822] 10.222.0.13 () {58 vars in 1413 bytes} [Thu Oct 20 14:47:26 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/6d078144-b9b7-4c5b-aeb0-8a3819056305 => generated 194 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:26.841221 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:26.841721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:26.848809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.849299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.849740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.850450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:26.851388 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:26.851833 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:26.939424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lazy-loading 'services' on Instance uuid d10aa467-2dd1-482b-9e1e-1e1f43e1aafa {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:47:27.018106 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-770d7759-1fa0-4b0b-bd32-338ba71994ed tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/6d078144-b9b7-4c5b-aeb0-8a3819056305" status: 202 len: 0 microversion: 2.1 time: 0.180615 Oct 20 14:47:27.018854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 403/823] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:47:26 2022] DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments/6d078144-b9b7-4c5b-aeb0-8a3819056305 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:47:27.618473 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:27.620813 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:27.622083 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:27.622937 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:27.627003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.627713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.628147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.628870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.629319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.629735 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.630089 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.630953 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.631397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.632152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.632628 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.633050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.661706 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2357a39e-c337-4195-bc10-f1bcb0d8d579 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047437 Oct 20 14:47:27.662394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 421/824] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:27 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 14:47:27.737548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:27.738472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:27.746737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.747706 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.748371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.749565 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.750251 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.750879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.807001 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:47:27.813484 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:27.821288 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-25fc7c50-e3fc-4598-b760-bfcde79963d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.203926 Oct 20 14:47:27.822168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 404/825] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:27 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:47:27.867184 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:27.902352 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-43b38fee-c05a-4ae8-a768-3b3e7c7096e2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 204 len: 0 microversion: 2.1 time: 0.170058 Oct 20 14:47:27.903011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 422/826] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:27 2022] DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:47:27.911225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:27.911837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:27.918337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.919043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.919541 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:27.920252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:27.920802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:27.921256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.060626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:28.075414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7a2cf23-1f83-4a86-9fe3-6b2b12d795a8 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1683 microversion: 2.1 time: 0.167822 Oct 20 14:47:28.075847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 405/827] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:27 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:28.210907 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:28.213146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:28.219714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.220258 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.220720 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.221403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.222024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.222441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.252210 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a5f0b422-a458-4137-9214-d076dceb0069 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045538 Oct 20 14:47:28.252794 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 423/828] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:28 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 20 14:47:28.381256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:28.383790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:28.390080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.390589 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.390987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.391684 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.392129 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.392575 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.423017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-56c2eddb-b3a8-4460-89e1-0d9ebcc4d657 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045691 Oct 20 14:47:28.423597 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 406/829] 10.222.0.13 () {58 vars in 1302 bytes} [Thu Oct 20 14:47:28 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 20 14:47:28.491398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:28.491934 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:28.498303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.498846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.499188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.500471 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.501050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.501391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.526090 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:47:28.604581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2f193784-f340-4db6-93fc-d6e329c68439 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 204 len: 0 microversion: 2.1 time: 0.116513 Oct 20 14:47:28.605349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 424/830] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:28 2022] DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:47:28.613704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:28.614312 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:28.620894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.621373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.621803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.622493 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.623049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.623348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.755040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:28.763939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6f091882-efe0-4ea6-aa59-fee6c75e85ad tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1669 microversion: 2.1 time: 0.154400 Oct 20 14:47:28.764535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 407/831] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:28 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1669 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:47:28.845597 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:28.846480 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:28.853036 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.853516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.853945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.854893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:28.855539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:28.855963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:28.991048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:28.998770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4ad36e71-8118-44bd-89ea-35f96194fd8d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.157421 Oct 20 14:47:28.999336 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 425/832] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:28 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:29.099168 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:29.100099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:29.106564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:29.107055 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:29.107494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:29.108200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:29.108703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:29.109135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:29.255107 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:29.262963 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4587b0df-85e0-4505-b377-91d532c79238 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1683 microversion: 2.1 time: 0.167636 Oct 20 14:47:29.263600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 408/833] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:29 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:29.787707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:29.788316 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:29.794299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:29.794777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:29.795204 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:29.795883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:29.796331 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:29.796798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:29.932372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:29.940570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-842fe5e5-ce97-4448-9f54-38bfec3bf437 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1669 microversion: 2.1 time: 0.156693 Oct 20 14:47:29.941142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 426/834] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:29 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:30.022113 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:30.022724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:30.029053 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:30.029545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:30.029968 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:30.030649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:30.031099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:30.031556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:30.034250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:30.162412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:30.170122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-22e5a15a-0a44-4aad-9f37-609fb6af8825 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.151838 Oct 20 14:47:30.170688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 409/835] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:30 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:30.286707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:30.287415 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:30.293749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:30.294298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:30.294794 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:30.295902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:30.296133 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:30.296636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:30.445152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:30.452818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-31bebec9-af80-4fa3-a493-9ccd7f951785 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1683 microversion: 2.1 time: 0.169993 Oct 20 14:47:30.460577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 427/836] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:30 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1683 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:30.964773 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:30.965584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:30.971998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:30.972517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:30.972952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:30.973667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:30.974116 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:30.974536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:31.108736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:31.117579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fe50def7-13ae-438d-b2c4-19373c959d9c tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1669 microversion: 2.1 time: 0.157362 Oct 20 14:47:31.118147 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 410/837] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:30 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1669 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:31.193833 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:31.194465 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:31.200811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:31.201287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:31.201713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:31.202390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:31.202835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:31.203246 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:31.330080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:31.337722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b3cf5b25-ec0b-4662-86dd-b65419e08f46 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.147649 Oct 20 14:47:31.338288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 428/838] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:31 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:31.476548 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:31.477162 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:31.483336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:31.483811 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:31.484238 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:31.485573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:31.486023 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:31.486441 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:31.616062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:31.623790 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6fcd3687-b433-4d0b-ba42-642b101db62f tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1683 microversion: 2.1 time: 0.151172 Oct 20 14:47:31.624600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 411/839] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:31 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1683 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:47:32.142002 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:32.142531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:32.148572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:32.149060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:32.149494 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:32.150190 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:32.150646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:32.151071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:32.286506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:32.294598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f0a9abdc-8768-4780-90e6-9de604a0a0e7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1669 microversion: 2.1 time: 0.157152 Oct 20 14:47:32.295181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 429/840] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:32 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1669 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:32.361323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:32.361933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:32.368330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:32.368842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:32.369272 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:32.369958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:32.370405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:32.370824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:32.510183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:32.518679 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-877582f9-4445-452b-a68d-bd1cac9fd174 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.161461 Oct 20 14:47:32.519354 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 412/841] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:32 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:32.647425 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:32.648042 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:32.654302 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:32.654796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:32.655233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:32.655989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:32.657047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:32.657538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:32.725029 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:32.733698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6c313812-092a-4241-b49f-a4301a90e5cf tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1615 microversion: 2.1 time: 0.090176 Oct 20 14:47:32.734353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 430/842] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:32 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1615 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:33.103870 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-3a6f8fa1-2e0d-4459-9250-cd6d52ead12e req-d9f24fe6-2647-46f6-88e5-63186f758fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e4caff2a-4143-4567-bb70-554451cc1b0d", "name": "network-vif-deleted", "tag": "1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:33.117681 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3a6f8fa1-2e0d-4459-9250-cd6d52ead12e req-d9f24fe6-2647-46f6-88e5-63186f758fe1 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.118579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3a6f8fa1-2e0d-4459-9250-cd6d52ead12e req-d9f24fe6-2647-46f6-88e5-63186f758fe1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.119269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3a6f8fa1-2e0d-4459-9250-cd6d52ead12e req-d9f24fe6-2647-46f6-88e5-63186f758fe1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.135012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-3a6f8fa1-2e0d-4459-9250-cd6d52ead12e req-d9f24fe6-2647-46f6-88e5-63186f758fe1 service nova] Creating event network-vif-deleted:1d5ef3e8-9d5e-4ac2-b3db-2ba9dd517368 for instance e4caff2a-4143-4567-bb70-554451cc1b0d on hv-cinder-77923 Oct 20 14:47:33.142752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-3a6f8fa1-2e0d-4459-9250-cd6d52ead12e req-d9f24fe6-2647-46f6-88e5-63186f758fe1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042797 Oct 20 14:47:33.148031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 413/843] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:33.320531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:33.321140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:33.333322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.336110 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.341677 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.343491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.346241 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.362044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.405472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.407072 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.407896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.408896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lazy-loading 'fault' on Instance uuid d10aa467-2dd1-482b-9e1e-1e1f43e1aafa {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:47:33.471823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4d74d7fd62cd464183f9df4ca581833c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a3d7fadfead1456792446f71c465bc0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:33.481686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b8da79c6-17a1-435e-ab0b-a230a38ae5b8 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 200 len: 1325 microversion: 2.1 time: 0.166795 Oct 20 14:47:33.483225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 431/844] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:33 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 1325 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:33.542907 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:33.543609 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:33.550774 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.551256 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.551930 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.552846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.553531 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.554152 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.746853 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:33.757796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:33.759634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:33.779989 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.782751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-be87d673-a7df-4c5f-b7a0-c53f8068597f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.242966 Oct 20 14:47:33.783577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.784030 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.785601 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 414/845] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:33 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:33.791558 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.792056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.792532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.864162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:33.865292 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:33.865733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:33.866381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lazy-loading 'fault' on Instance uuid e4caff2a-4143-4567-bb70-554451cc1b0d {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:47:33.922778 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e0d4be0e0f744242a323ac9694aef9ad', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8d8d1dfd3c714794a3fca61b2c6b093e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:33.931626 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-161be211-e391-474c-8817-0b0e0ad15fae tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 200 len: 1332 microversion: 2.1 time: 0.178066 Oct 20 14:47:33.932466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 432/846] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:33 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 1332 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:47:34.508248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:34.509542 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:34.517252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.517807 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.518302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.519069 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.519584 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.520187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.534666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] HTTP exception thrown: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Request method failure captured: Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa HTTP/1.1 Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4D5gcewTkwFK0OyedwlqBwK-qNHv86mErNiaHt5_8qXpz7WhVIHxQ0PzgyQoYzWPAPy42CX7tRLOvezIk9i1kdX2ivIdLQHvLoOU4lbatOipUJC4L6_GejtQtvNkAN9qZ_FrUhI8e5yKowf-cfgpUdWeMiWdxuAO5qjzj-6zBE9lI Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:34.536419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 4d74d7fd62cd464183f9df4ca581833c Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:34.537961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'd10aa467-2dd1-482b-9e1e-1e1f43e1aafa'} Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:34.538730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:34.540874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.542727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Returning 404 to user: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:34.542727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5c2c9e2e-5da4-4455-960b-5fd0345326f7 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 404 len: 111 microversion: 2.1 time: 0.034452 Oct 20 14:47:34.542727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 415/847] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:34 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:34.546631 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b29b6b26-aac5-4148-bd24-e2d9dfbbf346 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '.version_select at 0x7f6344c6cdc0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:34.566337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b29b6b26-aac5-4148-bd24-e2d9dfbbf346 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-90918464" status: 202 len: 0 microversion: 2.1 time: 0.023393 Oct 20 14:47:34.566913 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 433/848] 10.222.0.13 () {58 vars in 1215 bytes} [Thu Oct 20 14:47:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-90918464 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:47:34.806994 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:34.807599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:34.814566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.815077 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.815848 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.816915 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.817518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.828726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.850767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-753790c3-8882-444e-8e40-ee5b06a86f84 req-fa8e1fad-de4a-4f73-83f7-853ade48ce95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "name": "network-vif-plugged", "status": "completed", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:34.864337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-753790c3-8882-444e-8e40-ee5b06a86f84 req-fa8e1fad-de4a-4f73-83f7-853ade48ce95 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.865224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-753790c3-8882-444e-8e40-ee5b06a86f84 req-fa8e1fad-de4a-4f73-83f7-853ade48ce95 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.865827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-753790c3-8882-444e-8e40-ee5b06a86f84 req-fa8e1fad-de4a-4f73-83f7-853ade48ce95 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.877565 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-753790c3-8882-444e-8e40-ee5b06a86f84 req-fa8e1fad-de4a-4f73-83f7-853ade48ce95 service nova] Creating event network-vif-plugged:0526eee3-ed29-410b-be9e-e1916564638c for instance a4919bb2-0fa7-455d-bb9e-55db2807713c on hv-cinder-77923 Oct 20 14:47:34.883600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-753790c3-8882-444e-8e40-ee5b06a86f84 req-fa8e1fad-de4a-4f73-83f7-853ade48ce95 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036169 Oct 20 14:47:34.884820 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 434/849] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:34.961956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:34.962646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:34.972695 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.973182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.973616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.974368 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:34.974816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:34.975228 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:34.992019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d HTTP/1.1 Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:34.993948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:34.995641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'e4caff2a-4143-4567-bb70-554451cc1b0d'} Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:34.996583 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:34.998024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:35.001163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:35.002375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4cd3885a-0b22-40f2-a7ef-9a786b3593da tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 404 len: 111 microversion: 2.1 time: 0.044739 Oct 20 14:47:35.003396 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 435/850] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:34 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:35.011608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-45453cf6-2f31-4781-b9d0-f1e75adf1988 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '.version_select at 0x7f6344c038b0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:35.036724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-45453cf6-2f31-4781-b9d0-f1e75adf1988 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102424228" status: 202 len: 0 microversion: 2.1 time: 0.028855 Oct 20 14:47:35.038306 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 436/851] 10.222.0.13 () {58 vars in 1221 bytes} [Thu Oct 20 14:47:35 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2102424228 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 20 14:47:35.040703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:35.059054 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0cc76088-7ef2-4705-9d9f-34cb923ca267 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.252094 Oct 20 14:47:35.059739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 416/852] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:34 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:35.163560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-d4f92475-1e1b-4ef1-a530-6118cfd7d530 req-691f21f4-d507-4441-b994-06885e94e2ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d10aa467-2dd1-482b-9e1e-1e1f43e1aafa", "name": "network-vif-deleted", "tag": "a1e5a843-5c0f-440d-8b6e-9a45608a72c5"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:35.174945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d4f92475-1e1b-4ef1-a530-6118cfd7d530 req-691f21f4-d507-4441-b994-06885e94e2ba service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:35.175430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d4f92475-1e1b-4ef1-a530-6118cfd7d530 req-691f21f4-d507-4441-b994-06885e94e2ba service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:35.175861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d4f92475-1e1b-4ef1-a530-6118cfd7d530 req-691f21f4-d507-4441-b994-06885e94e2ba service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:35.188548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-d4f92475-1e1b-4ef1-a530-6118cfd7d530 req-691f21f4-d507-4441-b994-06885e94e2ba service nova] Creating event network-vif-deleted:a1e5a843-5c0f-440d-8b6e-9a45608a72c5 for instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa on hv-cinder-77923 Oct 20 14:47:35.196465 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-d4f92475-1e1b-4ef1-a530-6118cfd7d530 req-691f21f4-d507-4441-b994-06885e94e2ba service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036447 Oct 20 14:47:35.197060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 437/853] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:36.082908 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:36.083468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:36.090202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:36.090677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:36.091108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:36.091796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:36.092243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:36.092688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:36.226341 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:36.234261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5cbc3195-e4bd-4f0b-9f8b-3c4f90bd7b41 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1258 microversion: 2.1 time: 0.155802 Oct 20 14:47:36.235172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 417/854] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:36 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:37.024395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:37.024976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:37.030934 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.031444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.031869 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.032573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.033023 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.033441 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.046223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d HTTP/1.1 Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:37.048606 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.050163 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'e4caff2a-4143-4567-bb70-554451cc1b0d'} Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:37.051056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.052534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.054049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:37.054049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-06658e1a-d4df-4206-83e0-65dae922f379 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 404 len: 111 microversion: 2.1 time: 0.030241 Oct 20 14:47:37.054049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 438/855] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:37 2022] DELETE /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:37.058247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:37.058884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: e4caff2a-4143-4567-bb70-554451cc1b0d] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:37.065685 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.066165 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.066595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.067275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.067725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.068145 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.083525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d HTTP/1.1 Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:37.085096 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.086675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'e4caff2a-4143-4567-bb70-554451cc1b0d'} Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:37.087626 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. Oct 20 14:47:37.089187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.090889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance e4caff2a-4143-4567-bb70-554451cc1b0d could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:37.090889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8b8cfacc-da08-4f01-997a-2834f3b723d2 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d" status: 404 len: 111 microversion: 2.1 time: 0.032100 Oct 20 14:47:37.090889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 418/856] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:37 2022] GET /compute/v2.1/servers/e4caff2a-4143-4567-bb70-554451cc1b0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:37.256475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:37.257080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:37.263000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.263484 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.263908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.264697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.265199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.265616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.404635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:37.413106 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-29235b1d-62e6-45b9-87c8-50bf34ca534d tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1442 microversion: 2.1 time: 0.160462 Oct 20 14:47:37.414174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 439/857] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:37 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1442 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:37.438673 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:37.439363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:37.446303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.446911 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.447422 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.448261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.448809 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.449306 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.597475 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:37.605585 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-af97eefb-c854-4676-84b7-680cfeb32579 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1442 microversion: 2.1 time: 0.172394 Oct 20 14:47:37.606163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 419/858] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:37 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1442 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:37.778256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:37.779044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:37.785988 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.786472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.786903 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.787596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.788049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.788505 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.802409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] HTTP exception thrown: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Request method failure captured: Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa HTTP/1.1 Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4D5gcewTkwFK0OyedwlqBwK-qNHv86mErNiaHt5_8qXpz7WhVIHxQ0PzgyQoYzWPAPy42CX7tRLOvezIk9i1kdX2ivIdLQHvLoOU4lbatOipUJC4L6_GejtQtvNkAN9qZ_FrUhI8e5yKowf-cfgpUdWeMiWdxuAO5qjzj-6zBE9lI Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:37.803991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 4d74d7fd62cd464183f9df4ca581833c Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.805590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'd10aa467-2dd1-482b-9e1e-1e1f43e1aafa'} Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:37.806349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.807532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.808749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Returning 404 to user: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:37.808749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5715fbf1-63a2-4a5b-af55-e8fd971859a3 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 404 len: 111 microversion: 2.1 time: 0.030967 Oct 20 14:47:37.808749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 440/859] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:37 2022] DELETE /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:37.813901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:37.814533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: d10aa467-2dd1-482b-9e1e-1e1f43e1aafa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:37.820400 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.820892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.821330 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.822030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:37.822486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:37.822913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:37.837232 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] HTTP exception thrown: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Request method failure captured: Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa HTTP/1.1 Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4D5gcewTkwFK0OyedwlqBwK-qNHv86mErNiaHt5_8qXpz7WhVIHxQ0PzgyQoYzWPAPy42CX7tRLOvezIk9i1kdX2ivIdLQHvLoOU4lbatOipUJC4L6_GejtQtvNkAN9qZ_FrUhI8e5yKowf-cfgpUdWeMiWdxuAO5qjzj-6zBE9lI Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:37.838824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 4d74d7fd62cd464183f9df4ca581833c Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.840291 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'd10aa467-2dd1-482b-9e1e-1e1f43e1aafa'} Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:37.841183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. Oct 20 14:47:37.842348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:37.843707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Returning 404 to user: Instance d10aa467-2dd1-482b-9e1e-1e1f43e1aafa could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:37.843707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-65a58df0-c85c-4863-a609-1ad52617ddda tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa" status: 404 len: 111 microversion: 2.1 time: 0.030196 Oct 20 14:47:37.843707 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 420/860] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:37 2022] GET /compute/v2.1/servers/d10aa467-2dd1-482b-9e1e-1e1f43e1aafa => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:38.222639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:38.223355 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:38.230485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.231195 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.231746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.232555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.233081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.233581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.247116 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b HTTP/1.1 Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:38.248686 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.250156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'c7254508-d290-4971-a856-7c9afb57161b'} Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:38.252082 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.253351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.254531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:38.254531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-31a111d3-4e4d-4219-8e39-d34b50275986 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 404 len: 111 microversion: 2.1 time: 0.031445 Oct 20 14:47:38.254531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 441/861] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:38 2022] DELETE /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:38.260237 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:38.261610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: c7254508-d290-4971-a856-7c9afb57161b] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:38.268986 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.269822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.270267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.270981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.271441 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.271874 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.285893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b HTTP/1.1 Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:38.287482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.289130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'c7254508-d290-4971-a856-7c9afb57161b'} Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:38.290018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. Oct 20 14:47:38.291333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.292797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance c7254508-d290-4971-a856-7c9afb57161b could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:38.292797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-30782b5b-44e9-4702-a48e-97bdea373051 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b" status: 404 len: 111 microversion: 2.1 time: 0.033616 Oct 20 14:47:38.292797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 421/862] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:38 2022] GET /compute/v2.1/servers/c7254508-d290-4971-a856-7c9afb57161b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:38.299147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:38.299887 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:38.305858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.306413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.306915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.307690 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.308215 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.308732 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.323871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 HTTP/1.1 Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:38.325528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.326910 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '14f6dc2d-fbc2-404a-b288-0e73feaedb92'} Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:38.327970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.330217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.331758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:38.331758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-198ee02e-7aa8-4a0a-b2e7-6d378245ea8c tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 404 len: 111 microversion: 2.1 time: 0.032807 Oct 20 14:47:38.331758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 442/863] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:38 2022] DELETE /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:38.340206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:38.340927 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: 14f6dc2d-fbc2-404a-b288-0e73feaedb92] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:38.348056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.348582 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.349026 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.349736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:38.350191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:38.350615 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:38.367524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 HTTP/1.1 Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:38.369130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.370683 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '14f6dc2d-fbc2-404a-b288-0e73feaedb92'} Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:38.371552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. Oct 20 14:47:38.372837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:38.373906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance 14f6dc2d-fbc2-404a-b288-0e73feaedb92 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:38.373906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-3ba3cba8-2b50-4f79-a59d-2f106bb50644 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92" status: 404 len: 111 microversion: 2.1 time: 0.037315 Oct 20 14:47:38.373906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 422/864] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:38 2022] GET /compute/v2.1/servers/14f6dc2d-fbc2-404a-b288-0e73feaedb92 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:38.992648 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:38.993372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.001517 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.001685 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.002330 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.003229 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.003674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.004291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.019636 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] HTTP exception thrown: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Request method failure captured: Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad HTTP/1.1 Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4D5gcewTkwFK0OyedwlqBwK-qNHv86mErNiaHt5_8qXpz7WhVIHxQ0PzgyQoYzWPAPy42CX7tRLOvezIk9i1kdX2ivIdLQHvLoOU4lbatOipUJC4L6_GejtQtvNkAN9qZ_FrUhI8e5yKowf-cfgpUdWeMiWdxuAO5qjzj-6zBE9lI Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:39.021282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 4d74d7fd62cd464183f9df4ca581833c Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.022951 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '38c72900-27b7-470e-9d95-752506e689ad'} Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:39.023829 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.025181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.027152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Returning 404 to user: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:39.028148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d86e15c9-68b9-479f-8f4e-07046ae8e298 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 404 len: 111 microversion: 2.1 time: 0.041263 Oct 20 14:47:39.028878 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 443/865] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:38 2022] DELETE /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:39.037675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:39.038375 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] [instance: 38c72900-27b7-470e-9d95-752506e689ad] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.045340 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.045823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.046258 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.046955 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.047588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.048507 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.062566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] HTTP exception thrown: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Request method failure captured: Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad HTTP/1.1 Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4D5gcewTkwFK0OyedwlqBwK-qNHv86mErNiaHt5_8qXpz7WhVIHxQ0PzgyQoYzWPAPy42CX7tRLOvezIk9i1kdX2ivIdLQHvLoOU4lbatOipUJC4L6_GejtQtvNkAN9qZ_FrUhI8e5yKowf-cfgpUdWeMiWdxuAO5qjzj-6zBE9lI Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:39.064150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/a3d7fadfead1456792446f71c465bc0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: a3d7fadfead1456792446f71c465bc0c Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeTestJSON-446872173 Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 4d74d7fd62cd464183f9df4ca581833c Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeTestJSON-446872173-project Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.065797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '38c72900-27b7-470e-9d95-752506e689ad'} Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:39.069130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. Oct 20 14:47:39.070540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.072037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] Returning 404 to user: Instance 38c72900-27b7-470e-9d95-752506e689ad could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:39.072037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4ab8effb-68e3-42db-b92d-278641c8e042 tempest-AttachVolumeTestJSON-446872173 tempest-AttachVolumeTestJSON-446872173-project] 10.222.0.13 "GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad" status: 404 len: 111 microversion: 2.1 time: 0.031725 Oct 20 14:47:39.072037 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 423/866] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:39 2022] GET /compute/v2.1/servers/38c72900-27b7-470e-9d95-752506e689ad => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:39.406867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:39.409113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.415737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.416228 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.416692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.417400 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.417857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.418283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.437075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:39.452011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c7860020-2553-4ed0-84ca-910732b1d518 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049137 Oct 20 14:47:39.452612 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 444/867] 10.222.0.13 () {60 vars in 1343 bytes} [Thu Oct 20 14:47:39 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:47:39.520948 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:39.521466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:39.521466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.522307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.527723 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.528198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.528543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.528993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.529315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.529496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.530017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.530467 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.530572 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.530885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.531018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.531659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.545538 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 HTTP/1.1 Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:39.547201 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.548967 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'da8d0a95-894e-4244-9a27-6b86a1b5ca83'} Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:39.552890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.554095 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.555317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:39.555317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ce6b8d25-5d2c-4071-aea0-43db91f70efd tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 404 len: 111 microversion: 2.1 time: 0.032239 Oct 20 14:47:39.555317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 445/868] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:47:39 2022] DELETE /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:39.558304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:39.559007 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] [instance: da8d0a95-894e-4244-9a27-6b86a1b5ca83] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.566140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.566791 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.567239 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.567950 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.568446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.568880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.570297 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:47:39.583664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] HTTP exception thrown: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Request method failure captured: Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 HTTP/1.1 Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4B47x7MDNfiMAHMR-bL-0ne3MlsU5ksWlSI1mYa7irPk5E0aUjKApcYwq26hhOpzgxk45EsjxydEcbZk1zNvIXNPrL3q_lxO1AQZIIMj9wQI4JKi6FpLEb7qVanpJslHIZoWO9AGQb60rFi0qG6JV5XfDJhulK2UqWRSyY_H4wb-c Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:39.585261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/8d8d1dfd3c714794a3fca61b2c6b093e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 8d8d1dfd3c714794a3fca61b2c6b093e Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1254185158 Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: e0d4be0e0f744242a323ac9694aef9ad Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeNegativeTest-1254185158-project Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.586821 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'da8d0a95-894e-4244-9a27-6b86a1b5ca83'} Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:39.587714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. Oct 20 14:47:39.589182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:39.590525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] Returning 404 to user: Instance da8d0a95-894e-4244-9a27-6b86a1b5ca83 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:39.590525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-73b5c086-ae14-4799-883a-b970bbd8c087 tempest-AttachVolumeNegativeTest-1254185158 tempest-AttachVolumeNegativeTest-1254185158-project] 10.222.0.13 "GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83" status: 404 len: 111 microversion: 2.1 time: 0.032476 Oct 20 14:47:39.590525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 446/869] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:47:39 2022] GET /compute/v2.1/servers/da8d0a95-894e-4244-9a27-6b86a1b5ca83 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:39.673686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4bc3a7f7-1257-4d91-aac2-1149bfab1824 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 204 len: 0 microversion: 2.20 time: 0.157881 Oct 20 14:47:39.674704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 424/870] 10.222.0.13 () {60 vars in 1280 bytes} [Thu Oct 20 14:47:39 2022] DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 14:47:39.687009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:39.688008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:39.697620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.698393 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.699024 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:39.700084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:39.700768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:39.701734 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:40.041063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:40.050229 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:40.051699 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:40.052862 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-eb97c215-f383-4fb6-bebd-5dbf3a7731fa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.373879 Oct 20 14:47:40.063607 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 447/871] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:39 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:47:40.097679 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-1dde86f4-a8e3-4e2e-8275-a2569f688c64 req-3a5f243c-1e5d-4075-9f69-9faad283800e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:40.117202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1dde86f4-a8e3-4e2e-8275-a2569f688c64 req-3a5f243c-1e5d-4075-9f69-9faad283800e service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:40.120861 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1dde86f4-a8e3-4e2e-8275-a2569f688c64 req-3a5f243c-1e5d-4075-9f69-9faad283800e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:40.121878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-1dde86f4-a8e3-4e2e-8275-a2569f688c64 req-3a5f243c-1e5d-4075-9f69-9faad283800e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:40.139867 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-1dde86f4-a8e3-4e2e-8275-a2569f688c64 req-3a5f243c-1e5d-4075-9f69-9faad283800e service nova] Creating event network-changed:0526eee3-ed29-410b-be9e-e1916564638c for instance a4919bb2-0fa7-455d-bb9e-55db2807713c on hv-cinder-77923 Oct 20 14:47:40.152012 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-1dde86f4-a8e3-4e2e-8275-a2569f688c64 req-3a5f243c-1e5d-4075-9f69-9faad283800e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062914 Oct 20 14:47:40.153638 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 425/872] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:41.082461 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:41.083383 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:41.094188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:41.097490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:41.098046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:41.099419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:41.101194 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:41.101736 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:41.517376 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:41.538782 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:41.540871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:41.542165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-e726a005-7371-4786-ae47-7fde4ed5228d tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.464628 Oct 20 14:47:41.543873 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 448/873] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:41 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:47:42.573995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:42.575429 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:42.587732 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:42.588457 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:42.589066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:42.589952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:42.594285 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:42.595691 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:42.915739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:42.936903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:42.939409 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:42.946352 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2fd3f2ca-a3df-4632-bdfe-c8bdb3859d7c tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1724 microversion: 2.20 time: 0.377643 Oct 20 14:47:42.949779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 426/874] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:42 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1724 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:47:43.975918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:43.977599 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:44.017499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-47494794-8235-47cb-9fe1-20a8e937aeed req-44ae768c-ff40-449e-81ff-706595e6c160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "51cb557d-d0f7-4b32-bc95-04812c917244", "name": "network-vif-deleted", "tag": "20cf55bd-3d91-4bda-9c08-8252ca71c6a7"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:44.040443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:44.040944 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:44.041392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:44.042137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:44.042557 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:44.042959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:44.053072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-47494794-8235-47cb-9fe1-20a8e937aeed req-44ae768c-ff40-449e-81ff-706595e6c160 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:44.053666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-47494794-8235-47cb-9fe1-20a8e937aeed req-44ae768c-ff40-449e-81ff-706595e6c160 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:44.054129 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-47494794-8235-47cb-9fe1-20a8e937aeed req-44ae768c-ff40-449e-81ff-706595e6c160 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:44.077941 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-47494794-8235-47cb-9fe1-20a8e937aeed req-44ae768c-ff40-449e-81ff-706595e6c160 service nova] Creating event network-vif-deleted:20cf55bd-3d91-4bda-9c08-8252ca71c6a7 for instance 51cb557d-d0f7-4b32-bc95-04812c917244 on hv-cinder-77923 Oct 20 14:47:44.098591 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-47494794-8235-47cb-9fe1-20a8e937aeed req-44ae768c-ff40-449e-81ff-706595e6c160 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103605 Oct 20 14:47:44.099529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 427/875] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:47:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:44.219180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:44.235339 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:44.237397 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '9fc72f6965bb4814a5d85bd04769e4cb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afd56c15beff4515a44799ee7ec083a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:47:44.239430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-944934eb-112d-43bf-9bf9-3e46b0767157 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 200 len: 1367 microversion: 2.20 time: 0.268616 Oct 20 14:47:44.240193 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 449/876] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:43 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 20 14:47:45.268156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:45.269154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:45.282143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:45.284131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:45.287386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:45.288413 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:45.289816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:45.292183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:45.324765 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] HTTP exception thrown: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Request method failure captured: Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 HTTP/1.1 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4BBNwHeZvbdouXQ76-JomKKYMkXuNrzeqqn_egIpEbJUXeEOZ2zrl61HoNIDmvs3DcYumCw61_6G5sEhAm3KOdItJymvZllUbFe_t8-Ww53X0gaGLPS_y-sn-EgNt8F4uPec8pexBW8MeXQBF9yx7A5CZ8nzQgIk9n1VElARrKEWw Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:45.329310 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 9fc72f6965bb4814a5d85bd04769e4cb Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:45.331224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '51cb557d-d0f7-4b32-bc95-04812c917244'} Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:45.331992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:45.333325 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:45.334411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Returning 404 to user: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:45.334496 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d0594223-6f14-4042-887c-6693e144adad tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 404 len: 111 microversion: 2.20 time: 0.071913 Oct 20 14:47:45.335205 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 428/877] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:45 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 111 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 20 14:47:45.346165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-dc1f356a-b94f-4e16-bc34-c76306621fcf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '.version_select at 0x7f6344cd23a0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:45.382696 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-dc1f356a-b94f-4e16-bc34-c76306621fcf tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900109462" status: 204 len: 0 microversion: 2.20 time: 0.041368 Oct 20 14:47:45.386964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 450/878] 10.222.0.13 () {60 vars in 1262 bytes} [Thu Oct 20 14:47:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1900109462 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 20 14:47:47.863755 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:47.864827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:47.867805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:47.873761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:47.874468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:47.875105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:47.876779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:47.878429 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:47.879509 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:47.897878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] HTTP exception thrown: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Request method failure captured: Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 HTTP/1.1 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4BBNwHeZvbdouXQ76-JomKKYMkXuNrzeqqn_egIpEbJUXeEOZ2zrl61HoNIDmvs3DcYumCw61_6G5sEhAm3KOdItJymvZllUbFe_t8-Ww53X0gaGLPS_y-sn-EgNt8F4uPec8pexBW8MeXQBF9yx7A5CZ8nzQgIk9n1VElARrKEWw Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:47.899555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 9fc72f6965bb4814a5d85bd04769e4cb Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.901049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '51cb557d-d0f7-4b32-bc95-04812c917244'} Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:47.901822 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.903131 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.904334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Returning 404 to user: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:47.904334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e262180d-5d6a-4651-b811-45537f0278aa tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 404 len: 111 microversion: 2.20 time: 0.041596 Oct 20 14:47:47.904334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 429/879] 10.222.0.13 () {60 vars in 1280 bytes} [Thu Oct 20 14:47:47 2022] DELETE /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 20 14:47:47.913037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:47.913816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: 51cb557d-d0f7-4b32-bc95-04812c917244] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:47.921706 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:47.922220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:47.923363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:47.924067 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:47.924564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:47.925003 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:47.943016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] HTTP exception thrown: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Request method failure captured: Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 HTTP/1.1 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4BBNwHeZvbdouXQ76-JomKKYMkXuNrzeqqn_egIpEbJUXeEOZ2zrl61HoNIDmvs3DcYumCw61_6G5sEhAm3KOdItJymvZllUbFe_t8-Ww53X0gaGLPS_y-sn-EgNt8F4uPec8pexBW8MeXQBF9yx7A5CZ8nzQgIk9n1VElARrKEWw Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:47.944915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 9fc72f6965bb4814a5d85bd04769e4cb Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.947895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '51cb557d-d0f7-4b32-bc95-04812c917244'} Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:47.949456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. Oct 20 14:47:47.951555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:47.954250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Returning 404 to user: Instance 51cb557d-d0f7-4b32-bc95-04812c917244 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:47.954250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3c7797ac-47f9-4056-9cc2-4ee2d46b19bb tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244" status: 404 len: 111 microversion: 2.20 time: 0.037815 Oct 20 14:47:47.954250 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 451/880] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:47 2022] GET /compute/v2.1/servers/51cb557d-d0f7-4b32-bc95-04812c917244 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:47:48.684105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-874a9ec2-1c25-4553-a933-dee51a8f82d1 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Action: 'create', calling method: .version_select at 0x7f6344b51c10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1940062112", "metadata": {"Type": "work"}}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:49.027588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-874a9ec2-1c25-4553-a933-dee51a8f82d1 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.591815 Oct 20 14:47:49.030109 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 430/881] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Oct 20 14:47:48 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 595 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 20 14:47:49.042930 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-df2b3a07-4eed-40ae-903b-c863e9945903 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Calling method '.version_select at 0x7f63486428b0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:49.257103 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:49.257876 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:49.266747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:49.268418 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:49.269621 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:49.271345 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:49.272122 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:49.272796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:49.280888 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-df2b3a07-4eed-40ae-903b-c863e9945903 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1" status: 200 len: 353 microversion: 2.1 time: 0.241608 Oct 20 14:47:49.282332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 452/882] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:47:49 2022] GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 => generated 353 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:49.293786 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] HTTP exception thrown: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Request method failure captured: Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 HTTP/1.1 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV4BBNwHeZvbdouXQ76-JomKKYMkXuNrzeqqn_egIpEbJUXeEOZ2zrl61HoNIDmvs3DcYumCw61_6G5sEhAm3KOdItJymvZllUbFe_t8-Ww53X0gaGLPS_y-sn-EgNt8F4uPec8pexBW8MeXQBF9yx7A5CZ8nzQgIk9n1VElARrKEWw Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:49.296450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 9fc72f6965bb4814a5d85bd04769e4cb Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.298198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'a8a24968-9e6f-4fd7-9942-87adf39c1cc0'} Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:49.298933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.300108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.302305 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Returning 404 to user: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:49.303266 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b7ce2ce8-db64-4b2c-8e29-345dae378dbd tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 404 len: 111 microversion: 2.20 time: 0.050636 Oct 20 14:47:49.303910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 431/883] 10.222.0.13 () {60 vars in 1280 bytes} [Thu Oct 20 14:47:49 2022] DELETE /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Oct 20 14:47:49.312086 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:49.313256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] [instance: a8a24968-9e6f-4fd7-9942-87adf39c1cc0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:47:49.315126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:DELETE=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:47:49.321135 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:49.321590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:49.322446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:49.323313 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:47:49.323760 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:47:49.324379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:47:49.340255 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] HTTP exception thrown: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Request method failure captured: Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 HTTP/1.1 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV4BBNwHeZvbdouXQ76-JomKKYMkXuNrzeqqn_egIpEbJUXeEOZ2zrl61HoNIDmvs3DcYumCw61_6G5sEhAm3KOdItJymvZllUbFe_t8-Ww53X0gaGLPS_y-sn-EgNt8F4uPec8pexBW8MeXQBF9yx7A5CZ8nzQgIk9n1VElARrKEWw Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Openstack-Nova-Api-Version: 2.20 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:49.341835 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/afd56c15beff4515a44799ee7ec083a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: afd56c15beff4515a44799ee7ec083a3 Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1170036872 Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 9fc72f6965bb4814a5d85bd04769e4cb Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1170036872-project Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.343261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'a8a24968-9e6f-4fd7-9942-87adf39c1cc0'} Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:49.344225 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. Oct 20 14:47:49.346080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:49.347146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] Returning 404 to user: Instance a8a24968-9e6f-4fd7-9942-87adf39c1cc0 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:49.347146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f996da2c-e8ac-47af-ae82-ac470a4084c9 tempest-AttachVolumeShelveTestJSON-1170036872 tempest-AttachVolumeShelveTestJSON-1170036872-project] 10.222.0.13 "GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0" status: 404 len: 111 microversion: 2.20 time: 0.035164 Oct 20 14:47:49.347146 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 453/884] 10.222.0.13 () {60 vars in 1277 bytes} [Thu Oct 20 14:47:49 2022] GET /compute/v2.1/servers/a8a24968-9e6f-4fd7-9942-87adf39c1cc0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:47:50.296595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4a80674d-a14a-4a3a-9a6f-1b9cf25797b7 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Calling method '.version_select at 0x7f6344d23160>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:50.362226 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4a80674d-a14a-4a3a-9a6f-1b9cf25797b7 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1" status: 200 len: 354 microversion: 2.1 time: 0.069567 Oct 20 14:47:50.363101 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 432/885] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:47:50 2022] GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 => generated 354 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:50.387058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9c26fa93-b14e-48af-ae93-867096813b7a tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Calling method '.version_select at 0x7f6348642ca0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:50.551582 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9c26fa93-b14e-48af-ae93-867096813b7a tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1" status: 200 len: 354 microversion: 2.1 time: 0.179342 Oct 20 14:47:50.552185 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 454/886] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:47:50 2022] GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 => generated 354 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:50.566382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-707625be-fee3-4711-9ca9-2e0869d3cf11 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Calling method '.version_select at 0x7f6344d00b80>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:50.683703 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-707625be-fee3-4711-9ca9-2e0869d3cf11 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1" status: 202 len: 0 microversion: 2.1 time: 0.121363 Oct 20 14:47:50.684470 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 433/887] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:47:50 2022] DELETE /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:47:50.693347 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-56e1a2af-37d6-4211-b41a-94c3513775d8 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Calling method '.version_select at 0x7f6344c6caf0>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:50.761187 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-56e1a2af-37d6-4211-b41a-94c3513775d8 tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1" status: 200 len: 353 microversion: 2.1 time: 0.071507 Oct 20 14:47:50.762035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 455/888] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:47:50 2022] GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:47:51.777769 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-87555013-ebf3-4d19-baf2-aa179f9dd06c tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Calling method '.version_select at 0x7f6344be1700>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:51.818549 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-87555013-ebf3-4d19-baf2-aa179f9dd06c tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] HTTP exception thrown: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-87555013-ebf3-4d19-baf2-aa179f9dd06c tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Request method failure captured: Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 HTTP/1.1 Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV-U45hb4dVFXxOghtqfjCjNCmxO-FGRrvSQ-Y-yMhHdhps8iTDKiqWehNf2cd_R55hA1gih3WFMcF4H_Md42vOVnk7ws92RShZjy15frUuzJgUdc60ikwiGEf2Xk_Klm4uxeSOWn_N4GCiSmr954tlScuKNg4DzcGwuLg4UCdq5o6g Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 36dbbca5eec64d4f83d4d1fc8dc7bdf3 Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesGetTestJSON-600349537 Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:51.821157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_36dbbca5eec64d4f83d4d1fc8dc7bdf3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/36dbbca5eec64d4f83d4d1fc8dc7bdf3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/36dbbca5eec64d4f83d4d1fc8dc7bdf3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/36dbbca5eec64d4f83d4d1fc8dc7bdf3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesGetTestJSON-600349537 Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 36dbbca5eec64d4f83d4d1fc8dc7bdf3 Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesGetTestJSON-600349537 Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesGetTestJSON-600349537-project Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 3387d3e9798f453ba6633b6c822b31db Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesGetTestJSON-600349537-project Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'ba08a09d-95f4-4c6a-9552-3d5c6b9800a1'} Oct 20 14:47:51.822478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. (HTTP 404) (Request-ID: req-23bcb85a-4f3c-4456-be39-e6c4f5c1f8bd) Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:51.823270 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:47:51.824643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 14:47:51.826048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. Oct 20 14:47:51.827211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:51.829903 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-87555013-ebf3-4d19-baf2-aa179f9dd06c tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] Returning 404 to user: Volume ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:51.830782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-87555013-ebf3-4d19-baf2-aa179f9dd06c tempest-VolumesGetTestJSON-600349537 tempest-VolumesGetTestJSON-600349537-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1" status: 404 len: 109 microversion: 2.1 time: 0.057450 Oct 20 14:47:51.831377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 434/889] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:47:51 2022] GET /compute/v2.1/os-volumes/ba08a09d-95f4-4c6a-9552-3d5c6b9800a1 => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:53.812206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d69ddd5f-7323-4e8b-869f-d0c9b577c927 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Action: 'create', calling method: .version_select at 0x7f6344c765e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254408604", "metadata": {"Type": "work"}}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d69ddd5f-7323-4e8b-869f-d0c9b577c927 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Request method failure captured: Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 122 Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV-ZtxFXf8DjaAIzMjE75H2bayI86WSWHq0-Z32uC5e5ODXMd_3zNCFsjzFetzhtUoucew1T17dvrR9AsnV0QBze801UIO7hmPxLEbfasUGzXlXe_6IslXpy3HoYpEl3IeC-RbDsLZBHsKkmyeRZ8YqWKG3BST34QOBT5j1JRToL81s Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:53.826366 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 2a294753ac24474d867ab0ce38602da6 Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1254408604", "metadata": {"Type": "work"}}} Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: Oct 20 14:47:53.828087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1254408604', 'metadata': {'Type': 'work'}}}} Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise error Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi '#$%' Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:53.830460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 14:47:53.833721 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 14:47:53.835217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 20 14:47:53.835217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.835217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-d69ddd5f-7323-4e8b-869f-d0c9b577c927 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:53.835217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-d69ddd5f-7323-4e8b-869f-d0c9b577c927 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.273270 Oct 20 14:47:53.835217 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 456/890] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Oct 20 14:47:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 275 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:47:53.840084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9f7a17c8-c843-473c-a3d9-b393cc4785f3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Action: 'create', calling method: .version_select at 0x7f6344d23040>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1589143897", "metadata": {"Type": "work"}}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9f7a17c8-c843-473c-a3d9-b393cc4785f3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Request method failure captured: Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 120 Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV-ZtxFXf8DjaAIzMjE75H2bayI86WSWHq0-Z32uC5e5ODXMd_3zNCFsjzFetzhtUoucew1T17dvrR9AsnV0QBze801UIO7hmPxLEbfasUGzXlXe_6IslXpy3HoYpEl3IeC-RbDsLZBHsKkmyeRZ8YqWKG3BST34QOBT5j1JRToL81s Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:53.845801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 2a294753ac24474d867ab0ce38602da6 Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1589143897", "metadata": {"Type": "work"}}} Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: Oct 20 14:47:53.847379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1589143897', 'metadata': {'Type': 'work'}}}} Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise error Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi '0' Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:53.848563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 14:47:53.854467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 14:47:53.855918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 20 14:47:53.855918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.855918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9f7a17c8-c843-473c-a3d9-b393cc4785f3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:53.855918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9f7a17c8-c843-473c-a3d9-b393cc4785f3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012938 Oct 20 14:47:53.855918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 435/891] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Oct 20 14:47:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:47:53.861827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-510ba3a7-9a37-4e79-a005-e2710198eba0 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Action: 'create', calling method: .version_select at 0x7f63486413a0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1579313140", "metadata": {"Type": "work"}}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-510ba3a7-9a37-4e79-a005-e2710198eba0 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Request method failure captured: Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 119 Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV-ZtxFXf8DjaAIzMjE75H2bayI86WSWHq0-Z32uC5e5ODXMd_3zNCFsjzFetzhtUoucew1T17dvrR9AsnV0QBze801UIO7hmPxLEbfasUGzXlXe_6IslXpy3HoYpEl3IeC-RbDsLZBHsKkmyeRZ8YqWKG3BST34QOBT5j1JRToL81s Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:53.865472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 2a294753ac24474d867ab0ce38602da6 Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1579313140", "metadata": {"Type": "work"}}} Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: Oct 20 14:47:53.867049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1579313140', 'metadata': {'Type': 'work'}}}} Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise error Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi '' Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:53.867939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 20 14:47:53.869920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 20 14:47:53.871403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 20 14:47:53.871403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.871403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-510ba3a7-9a37-4e79-a005-e2710198eba0 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:53.871403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-510ba3a7-9a37-4e79-a005-e2710198eba0 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009910 Oct 20 14:47:53.871403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 457/892] 10.222.0.13 () {60 vars in 1156 bytes} [Thu Oct 20 14:47:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 20 14:47:53.876913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f70796ed-dc31-4bcb-bf20-7b804fe50475 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Calling method '.version_select at 0x7f6344bf0c10>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:53.909154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-f70796ed-dc31-4bcb-bf20-7b804fe50475 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] HTTP exception thrown: Volume tempest-invalid-151603685 could not be found. Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f70796ed-dc31-4bcb-bf20-7b804fe50475 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Request method failure captured: Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-151603685 HTTP/1.1 Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV-ZtxFXf8DjaAIzMjE75H2bayI86WSWHq0-Z32uC5e5ODXMd_3zNCFsjzFetzhtUoucew1T17dvrR9AsnV0QBze801UIO7hmPxLEbfasUGzXlXe_6IslXpy3HoYpEl3IeC-RbDsLZBHsKkmyeRZ8YqWKG3BST34QOBT5j1JRToL81s Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:53.911087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 2a294753ac24474d867ab0ce38602da6 Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Volume tempest-invalid-151603685 could not be found. Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'tempest-invalid-151603685'} Oct 20 14:47:53.912698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-151603685 could not be found. (HTTP 404) (Request-ID: req-fb9c5130-d0f1-4571-a068-81256c7409b4) Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.913733 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 14:47:53.914938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-151603685 could not be found. Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:53.916062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-151603685 could not be found. Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-151603685 could not be found. Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f70796ed-dc31-4bcb-bf20-7b804fe50475 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Returning 404 to user: Volume tempest-invalid-151603685 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f70796ed-dc31-4bcb-bf20-7b804fe50475 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-151603685" status: 404 len: 98 microversion: 2.1 time: 0.040014 Oct 20 14:47:53.917442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 436/893] 10.222.0.13 () {58 vars in 1215 bytes} [Thu Oct 20 14:47:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-151603685 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 20 14:47:53.922639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ae8408f3-2b5b-4ac5-8811-b21b6c91751d tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003752 Oct 20 14:47:53.923165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 458/894] 10.222.0.13 () {58 vars in 1140 bytes} [Thu Oct 20 14:47:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Oct 20 14:47:53.931872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5bae3f39-7ee3-4d2f-9452-6a4113c75cae tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003785 Oct 20 14:47:53.932425 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 437/895] 10.222.0.13 () {58 vars in 1137 bytes} [Thu Oct 20 14:47:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 20 14:47:53.941800 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a84e4ffe-a8f2-46ff-b620-2641911f7f17 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Calling method '.version_select at 0x7f634868d820>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:53.971858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-a84e4ffe-a8f2-46ff-b620-2641911f7f17 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] HTTP exception thrown: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a84e4ffe-a8f2-46ff-b620-2641911f7f17 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Request method failure captured: Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/os-volumes/0426701f-2286-4432-aed6-7ccef2aebc8e HTTP/1.1 Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV-ZtxFXf8DjaAIzMjE75H2bayI86WSWHq0-Z32uC5e5ODXMd_3zNCFsjzFetzhtUoucew1T17dvrR9AsnV0QBze801UIO7hmPxLEbfasUGzXlXe_6IslXpy3HoYpEl3IeC-RbDsLZBHsKkmyeRZ8YqWKG3BST34QOBT5j1JRToL81s Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:47:53.973834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 2a294753ac24474d867ab0ce38602da6 Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '0426701f-2286-4432-aed6-7ccef2aebc8e'} Oct 20 14:47:53.975372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. (HTTP 404) (Request-ID: req-1a2acd27-1f66-4680-a2b2-a7d0e50b4139) Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.976372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 20 14:47:53.977770 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 20 14:47:53.979274 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a84e4ffe-a8f2-46ff-b620-2641911f7f17 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Returning 404 to user: Volume 0426701f-2286-4432-aed6-7ccef2aebc8e could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a84e4ffe-a8f2-46ff-b620-2641911f7f17 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/0426701f-2286-4432-aed6-7ccef2aebc8e" status: 404 len: 109 microversion: 2.1 time: 0.038134 Oct 20 14:47:53.980823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 459/896] 10.222.0.13 () {58 vars in 1248 bytes} [Thu Oct 20 14:47:53 2022] DELETE /compute/v2.1/os-volumes/0426701f-2286-4432-aed6-7ccef2aebc8e => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:47:53.987373 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c21b17a6-6307-42cc-aa40-a1e94a3952c3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Calling method '.version_select at 0x7f6344d23160>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:47:54.022714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-c21b17a6-6307-42cc-aa40-a1e94a3952c3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] HTTP exception thrown: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c21b17a6-6307-42cc-aa40-a1e94a3952c3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Request method failure captured: Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/os-volumes/91d50bea-5e9d-47d1-b200-06b8725cb470 HTTP/1.1 Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV-ZtxFXf8DjaAIzMjE75H2bayI86WSWHq0-Z32uC5e5ODXMd_3zNCFsjzFetzhtUoucew1T17dvrR9AsnV0QBze801UIO7hmPxLEbfasUGzXlXe_6IslXpy3HoYpEl3IeC-RbDsLZBHsKkmyeRZ8YqWKG3BST34QOBT5j1JRToL81s Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:47:54.024704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/0b0fdc0bfb304b718f26762c19a40d52"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 0b0fdc0bfb304b718f26762c19a40d52 Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesNegativeTest-1308371916 Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 2a294753ac24474d867ab0ce38602da6 Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesNegativeTest-1308371916-project Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '91d50bea-5e9d-47d1-b200-06b8725cb470'} Oct 20 14:47:54.026271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. (HTTP 404) (Request-ID: req-6f444234-c7c3-4549-8d21-f46ab787cc45) Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:54.027135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 20 14:47:54.028271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 20 14:47:54.029555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c21b17a6-6307-42cc-aa40-a1e94a3952c3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] Returning 404 to user: Volume 91d50bea-5e9d-47d1-b200-06b8725cb470 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c21b17a6-6307-42cc-aa40-a1e94a3952c3 tempest-VolumesNegativeTest-1308371916 tempest-VolumesNegativeTest-1308371916-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/91d50bea-5e9d-47d1-b200-06b8725cb470" status: 404 len: 109 microversion: 2.1 time: 0.043408 Oct 20 14:47:54.030946 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 438/897] 10.222.0.13 () {58 vars in 1245 bytes} [Thu Oct 20 14:47:53 2022] GET /compute/v2.1/os-volumes/91d50bea-5e9d-47d1-b200-06b8725cb470 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:48:28.292554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=28 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:28.293296 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:28.298722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1531143021", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1163109215", "security_groups": [{"name": "tempest-secgroup-smoke-41998486"}], "block_device_mapping_v2": [{"uuid": "1e22388e-80ec-4ed6-9a7d-dba414a9147d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c924697c-b180-4b1b-9f12-d7889a054b97"}]}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:28.418746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] validate_networks() for [('c924697c-b180-4b1b-9f12-d7889a054b97', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:48:28.941959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:48:28.942769 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:48:28.943402 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:48:28.944253 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:48:28.945162 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:48:28.954858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:28.956641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:28.957087 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:28.957824 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:28.958283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:28.958712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:28.977108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for project d5614088125349f1975cc55b25dd9dbc. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:48:28.982147 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Getting quotas for user ac5921418d40446c80892b04a3eee12d and project d5614088125349f1975cc55b25dd9dbc. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:48:29.077723 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:48:29.081779 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='1e22388e-80ec-4ed6-9a7d-dba414a9147d',volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:48:29.402313 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3a515193-7f93-4f25-81f5-057430ef6201 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.111269 Oct 20 14:48:29.403334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 460/898] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:48:28 2022] POST /compute/v2.1/servers => generated 404 bytes in 1113 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:48:29.414689 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:29.415677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:29.421610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9d185f6f-88cf-48d6-9751-ce4c414476ef tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:29.422263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9d185f6f-88cf-48d6-9751-ce4c414476ef tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:29.487250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9d185f6f-88cf-48d6-9751-ce4c414476ef tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:29.494883 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9d185f6f-88cf-48d6-9751-ce4c414476ef tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1095 microversion: 2.1 time: 0.082719 Oct 20 14:48:29.495472 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 439/899] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:29 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1095 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:30.521831 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:30.522544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:30.531164 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:30.532132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:30.533502 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:30.541367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:30.542099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:30.542867 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:30.626731 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:30.639084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0b4755c1-792a-4328-bcd0-fd28b112b914 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1193 microversion: 2.1 time: 0.123629 Oct 20 14:48:30.640881 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 461/900] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:30 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1193 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:31.668172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:31.668740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:31.674893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:31.675405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:31.675835 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:31.676804 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:31.677756 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:31.678469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:31.820483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:31.828503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6e40f834-dbea-45af-942f-cfa3c1988e6f tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1277 microversion: 2.1 time: 0.165287 Oct 20 14:48:31.830183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 440/901] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:31 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1277 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:32.853305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:32.853924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:32.860322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:32.861395 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:32.862061 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:32.862977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:32.863443 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:32.863852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:32.993453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:33.001232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-56571c32-5138-4aab-884f-ca6b6a4296b4 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1277 microversion: 2.1 time: 0.151848 Oct 20 14:48:33.001976 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 462/902] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:32 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1277 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:33.371664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-6da1cead-4fc5-4bc8-935a-686a99dd8ff0 req-4210df68-6725-4e20-815e-c4eda7ba3c49 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1625a58-d299-446e-81a2-4a623396811e", "tag": "f7f2b887-f376-4acb-bc3d-f1adb4222e6f"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:33.382594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6da1cead-4fc5-4bc8-935a-686a99dd8ff0 req-4210df68-6725-4e20-815e-c4eda7ba3c49 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:33.383183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6da1cead-4fc5-4bc8-935a-686a99dd8ff0 req-4210df68-6725-4e20-815e-c4eda7ba3c49 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:33.383723 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-6da1cead-4fc5-4bc8-935a-686a99dd8ff0 req-4210df68-6725-4e20-815e-c4eda7ba3c49 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:33.397985 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-6da1cead-4fc5-4bc8-935a-686a99dd8ff0 req-4210df68-6725-4e20-815e-c4eda7ba3c49 service nova] Creating event network-changed:f7f2b887-f376-4acb-bc3d-f1adb4222e6f for instance e1625a58-d299-446e-81a2-4a623396811e on hv-cinder-77923 Oct 20 14:48:33.403278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-6da1cead-4fc5-4bc8-935a-686a99dd8ff0 req-4210df68-6725-4e20-815e-c4eda7ba3c49 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035325 Oct 20 14:48:33.404070 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 441/903] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:48:34.024099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:34.024868 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:34.031447 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:34.031937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:34.032952 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:34.033692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:34.034197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:34.034621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:34.171148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:34.180103 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c8728d49-3559-4958-ae87-9a6b9ad8ec08 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1277 microversion: 2.1 time: 0.159685 Oct 20 14:48:34.180946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 463/904] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:34 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1277 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:34.840471 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-360626145", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:34.901825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] validate_networks() for None {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:48:35.203099 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:35.203715 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:35.205403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:48:35.205827 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:48:35.206337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:48:35.206802 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:48:35.207214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:48:35.211329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:35.211811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:35.212242 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:35.212964 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:35.213414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:35.213841 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:35.216318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:35.216895 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:35.217397 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:35.218223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:35.218682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:35.219135 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:35.236415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Getting quotas for project 76c13daa80f7403298c110265b3539a3. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:48:35.240459 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Getting quotas for user 182a86c0f20a4bd3bc7523cae7e829b3 and project 76c13daa80f7403298c110265b3539a3. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:48:35.252020 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:48:35.254455 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:48:35.300653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-341486f8-8451-4825-a68b-d0c3d9127cea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.464732 Oct 20 14:48:35.307210 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 442/905] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:48:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:48:35.313161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8477264d-cb3e-427d-a163-b9024cfc56d2 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:35.314387 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8477264d-cb3e-427d-a163-b9024cfc56d2 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:35.374629 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:35.383536 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ba89a5ea-34a2-47ad-97dc-0818211d68c7 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.184314 Oct 20 14:48:35.384105 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 464/906] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:35 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:35.397347 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8477264d-cb3e-427d-a163-b9024cfc56d2 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:35.404332 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8477264d-cb3e-427d-a163-b9024cfc56d2 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1214 microversion: 2.1 time: 0.095654 Oct 20 14:48:35.404940 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 443/907] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:35 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1214 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:36.405927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:36.406540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:36.412953 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:36.413436 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:36.413871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:36.414556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:36.415011 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:36.415433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:36.426965 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:36.427579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:36.434088 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:36.434567 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:36.434998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:36.435682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:36.436137 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:36.436586 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:36.509805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:36.518440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4d089568-9ff3-42c8-a097-228463f500ea tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1218 microversion: 2.1 time: 0.095365 Oct 20 14:48:36.519040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 444/908] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:36 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:36.570598 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:36.578207 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4e43a6ec-22df-490d-8aa8-f0a0a2ab6f17 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.176121 Oct 20 14:48:36.578852 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 465/909] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:36 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:37.541286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:37.541897 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:37.548666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:37.549154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:37.549594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:37.550289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:37.550747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:37.551172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:37.604008 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:37.604674 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:37.611509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:37.611948 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:37.612414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:37.613117 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:37.613575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:37.613917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:37.614057 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:37.621532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-0dd86deb-91fe-404f-b161-c86dd50b1505 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1218 microversion: 2.1 time: 0.084076 Oct 20 14:48:37.622099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 445/910] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:37 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:37.745474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:37.753375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-327d84e9-4b8f-4ba7-a3ae-0b16f3a01526 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.153690 Oct 20 14:48:37.753938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 466/911] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:37 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:38.645381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:38.646143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:38.654112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:38.654961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:38.655782 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:38.656872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:38.657490 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:38.657917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:38.729657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:38.737547 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-eb6c4031-cfbf-4a00-8b53-a99b0e0692d8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1274 microversion: 2.1 time: 0.097000 Oct 20 14:48:38.738433 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 446/912] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:38 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1274 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:38.778677 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:38.779382 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:38.786434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:38.786915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:38.787338 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:38.788027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:38.788501 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:38.788912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:38.925151 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:38.932848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-14c614b6-083f-4685-9860-f66ab1dbd509 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.158572 Oct 20 14:48:38.933498 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 467/913] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:38 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:39.761714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:39.762432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:39.770724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:39.771360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:39.772029 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:39.772882 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:39.773450 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:39.773980 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:39.958227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:39.959548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:39.961645 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:39.962539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:39.968896 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:39.970060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:39.970590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:39.971468 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:39.971954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:39.972816 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:40.208456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:40.218181 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2f828f5c-857b-48cf-aa86-49396f955ede tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.460624 Oct 20 14:48:40.228505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 447/914] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:39 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:40.276453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:40.284810 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7af9dac7-5c4a-436f-9c08-7994e61eb25e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.331706 Oct 20 14:48:40.285403 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 468/915] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:39 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:40.336225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a93559cf-3b82-48c4-87e3-60f1c7af4ac9 req-83c2c158-523b-4a3a-9c92-6f1f0083102b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "44ab85d7-45bc-4859-b029-a13206dfa7c9", "tag": "019654ca-916a-4872-bc03-b7224bb3ac8e"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:40.346286 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a93559cf-3b82-48c4-87e3-60f1c7af4ac9 req-83c2c158-523b-4a3a-9c92-6f1f0083102b service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:40.346758 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a93559cf-3b82-48c4-87e3-60f1c7af4ac9 req-83c2c158-523b-4a3a-9c92-6f1f0083102b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:40.347362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a93559cf-3b82-48c4-87e3-60f1c7af4ac9 req-83c2c158-523b-4a3a-9c92-6f1f0083102b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:40.362432 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a93559cf-3b82-48c4-87e3-60f1c7af4ac9 req-83c2c158-523b-4a3a-9c92-6f1f0083102b service nova] Creating event network-changed:019654ca-916a-4872-bc03-b7224bb3ac8e for instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 on hv-cinder-77923 Oct 20 14:48:40.368018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a93559cf-3b82-48c4-87e3-60f1c7af4ac9 req-83c2c158-523b-4a3a-9c92-6f1f0083102b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035554 Oct 20 14:48:40.368646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 448/916] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:48:41.242303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:41.242838 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:41.249842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:41.251308 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:41.251921 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:41.252895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:41.253410 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:41.254035 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:41.307501 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:41.308194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:41.321253 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:41.322264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:41.323155 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:41.324180 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:41.325747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:41.326580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:41.489404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:41.503438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fc1a36f4-3c0a-482f-9b36-28f1d407b82c tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.265087 Oct 20 14:48:41.504058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 469/917] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:41 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:41.519720 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:41.527741 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-286b808d-5c6b-458b-ab09-21bbf7d0a2be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.224310 Oct 20 14:48:41.528322 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 449/918] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:41 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:42.529332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:42.530353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:42.540556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:42.541865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:42.542462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:42.543982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:42.545228 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:42.545652 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:42.553495 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:42.554765 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:42.570275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:42.570889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:42.571488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:42.572580 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:42.573443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:42.574194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:42.885747 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:42.893605 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:42.911799 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6375872e-228d-46ec-8803-0a92b3e3ef7e tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.388107 Oct 20 14:48:42.915421 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c305d5b1-bd32-48ad-9ed8-2df75f855551 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.367838 Oct 20 14:48:42.916328 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 470/919] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:42 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:42.916726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 450/920] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:42 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:43.937448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:43.938750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:43.940307 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:43.941377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:43.946506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:43.947304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:43.949378 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:43.950929 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:43.951636 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:43.951777 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:43.952666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:43.954360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:43.955154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:43.955540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:43.956049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:43.956641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:44.231574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:44.259057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-69477597-c795-4478-9392-fbd4cc330fb3 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.323835 Oct 20 14:48:44.261016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 451/921] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:43 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:44.275938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:44.289842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-75cedfb2-259c-4b07-ac9d-d6fbe4cfa0dd tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.357472 Oct 20 14:48:44.300329 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 471/922] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:43 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:45.306599 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:45.307597 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:45.309664 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:45.316164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:45.316686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:45.317128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:45.317825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:45.317940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:45.318376 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:45.318542 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:45.318690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:45.325353 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:45.325847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:45.326286 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:45.326987 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:45.327438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:45.328068 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:45.401499 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=10 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:45.539048 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:45.544716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:45.548634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4671c039-24e9-45a6-afc8-09aae22bf557 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.245818 Oct 20 14:48:45.549797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 452/923] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:45 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:45.553872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8f936e40-d633-4e81-8f95-e112377ccfcb tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.239840 Oct 20 14:48:45.554879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 472/924] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:45 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:45.648167 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1007071552", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "networks": [{"uuid": "92c1189e-ce15-4ec8-b1e7-06403b47c306"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:45.727846 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] validate_networks() for [('92c1189e-ce15-4ec8-b1e7-06403b47c306', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:48:46.167257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:48:46.167672 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:48:46.168919 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:48:46.169326 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:48:46.169982 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:48:46.180003 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.181358 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.182091 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.183315 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.184289 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.185028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.209857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Getting quotas for project 34676c921ba04710b14cfa94eab069d3. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:48:46.215197 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Getting quotas for user 36a281f7f9c8435c8ad65ae4b0bf141a and project 34676c921ba04710b14cfa94eab069d3. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:48:46.234415 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-def55246-ba03-4eae-9ba6-9d49c0679084 req-81ec8bdf-4ddb-40b0-8a0e-2b9ec7c4e20e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ab85d7-45bc-4859-b029-a13206dfa7c9", "name": "network-vif-plugged", "status": "completed", "tag": "019654ca-916a-4872-bc03-b7224bb3ac8e"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:46.246949 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-def55246-ba03-4eae-9ba6-9d49c0679084 req-81ec8bdf-4ddb-40b0-8a0e-2b9ec7c4e20e service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.247859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-def55246-ba03-4eae-9ba6-9d49c0679084 req-81ec8bdf-4ddb-40b0-8a0e-2b9ec7c4e20e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.248425 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:48:46.248942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-def55246-ba03-4eae-9ba6-9d49c0679084 req-81ec8bdf-4ddb-40b0-8a0e-2b9ec7c4e20e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.257304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:48:46.262717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-def55246-ba03-4eae-9ba6-9d49c0679084 req-81ec8bdf-4ddb-40b0-8a0e-2b9ec7c4e20e service nova] Creating event network-vif-plugged:019654ca-916a-4872-bc03-b7224bb3ac8e for instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 on hv-cinder-77923 Oct 20 14:48:46.270417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-def55246-ba03-4eae-9ba6-9d49c0679084 req-81ec8bdf-4ddb-40b0-8a0e-2b9ec7c4e20e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040895 Oct 20 14:48:46.271019 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 473/925] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:48:46.358758 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-593aa567-e365-4711-a73b-86e89cc51cc3 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.714540 Oct 20 14:48:46.361590 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 453/926] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:48:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 718 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:48:46.374985 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-34644469-2ccf-4ebd-934c-fa272b38ea4f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:46.375752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-34644469-2ccf-4ebd-934c-fa272b38ea4f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:46.489544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-34644469-2ccf-4ebd-934c-fa272b38ea4f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:46.511109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-34644469-2ccf-4ebd-934c-fa272b38ea4f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1219 microversion: 2.1 time: 0.141460 Oct 20 14:48:46.514005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 474/927] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:46 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1219 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:46.572607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:46.581966 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:46.582883 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:46.583111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:46.597405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.598637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.599333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.600060 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.600767 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.601446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.602371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.603772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:46.604525 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.605204 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:46.605872 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.606502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:46.908595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:46.925241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aa815461-4158-481d-991b-ff7c6e803c7a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.356911 Oct 20 14:48:46.928709 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 454/928] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:46 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:46.980786 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:46.990797 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8fee45fc-512c-4c48-abd1-4177bf635bf8 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.412200 Oct 20 14:48:46.991462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 475/929] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:46 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:47.538697 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:47.539319 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:47.546260 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:47.547469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:47.548143 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:47.549130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:47.549606 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:47.550033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:47.633175 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:47.641646 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-71eac3b0-d796-4d4e-882a-68394ff2d10f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1271 microversion: 2.1 time: 0.106079 Oct 20 14:48:47.642224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 455/930] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:47 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:47.958394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:47.959148 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:47.965802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:47.966290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:47.966730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:47.967450 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:47.967898 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:47.968387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:48.018034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:48.018658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:48.028299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:48.029184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:48.029808 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:48.030734 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:48.031915 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:48.032570 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:48.187150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:48.196246 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0175fc64-8790-4d54-a747-7cf53eeba722 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.248862 Oct 20 14:48:48.197313 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 476/931] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:47 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:48.235089 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:48.243080 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9b2ed927-f033-46c8-b953-198147ea6296 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1314 microversion: 2.1 time: 0.232548 Oct 20 14:48:48.243651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 456/932] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:48 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:48.304390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-4978427d-a2be-4c10-89dc-8bdef001de8b req-42fd2577-c7fc-4a52-8229-47f43f18f5e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1625a58-d299-446e-81a2-4a623396811e", "name": "network-vif-plugged", "status": "completed", "tag": "f7f2b887-f376-4acb-bc3d-f1adb4222e6f"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:48.316690 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-4978427d-a2be-4c10-89dc-8bdef001de8b req-42fd2577-c7fc-4a52-8229-47f43f18f5e3 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:48.317157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-4978427d-a2be-4c10-89dc-8bdef001de8b req-42fd2577-c7fc-4a52-8229-47f43f18f5e3 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:48.317580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-4978427d-a2be-4c10-89dc-8bdef001de8b req-42fd2577-c7fc-4a52-8229-47f43f18f5e3 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:48.329477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-4978427d-a2be-4c10-89dc-8bdef001de8b req-42fd2577-c7fc-4a52-8229-47f43f18f5e3 service nova] Creating event network-vif-plugged:f7f2b887-f376-4acb-bc3d-f1adb4222e6f for instance e1625a58-d299-446e-81a2-4a623396811e on hv-cinder-77923 Oct 20 14:48:48.334850 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-4978427d-a2be-4c10-89dc-8bdef001de8b req-42fd2577-c7fc-4a52-8229-47f43f18f5e3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036637 Oct 20 14:48:48.335861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 477/933] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:48:48.665932 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:48.667091 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:48.675803 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:48.676676 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:48.677333 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:48.678447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:48.679094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:48.679915 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:48.773596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:48.782630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4fc0f5c7-b98d-4a30-9677-9caadc381f38 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1289 microversion: 2.1 time: 0.121228 Oct 20 14:48:48.799958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 457/934] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:48 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1289 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:49.222863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:49.223613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:49.230268 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.230722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.231182 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.231840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.232290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.232726 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.266524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:49.267382 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:49.273695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.274184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.274620 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.275320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.275795 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.276222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.465906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:49.474085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a9545314-31df-460b-b25f-d6045ac19e4e tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1265 microversion: 2.1 time: 0.256925 Oct 20 14:48:49.474947 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 478/935] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:49 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1265 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:49.481403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:49.490261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6f6e162b-20ca-4eac-a1a5-fb420221dcb4 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1462 microversion: 2.1 time: 0.227644 Oct 20 14:48:49.490894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 458/936] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:49 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1462 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:49.537738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:49.538305 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:49.544156 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.544781 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.545421 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.546172 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.546689 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.547834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.726365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=100 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:49.733180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:48:49.808386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:49.810507 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:49.825565 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.826092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.826536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.827337 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.827812 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.830327 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.838787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b235f570-fca0-4ca7-9f18-be8cdbe55b11 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "DELETE /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 204 len: 0 microversion: 2.1 time: 0.304443 Oct 20 14:48:49.840482 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 479/937] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:48:49 2022] DELETE /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:48:49.869170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:49.870074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:49.878416 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.879115 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.879714 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:49.881387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:49.882267 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:49.883419 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:50.092099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:50.107819 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-987861ec-9e25-463c-b41e-72960c8b0a76 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.300730 Oct 20 14:48:50.117625 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 459/938] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:49 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:50.127299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:50.137021 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-caf4443a-38ae-4ac4-a5c3-f122f41418e1 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1468 microversion: 2.1 time: 0.280465 Oct 20 14:48:50.137918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 480/939] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:49 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1468 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:50.369419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-a20814d6-a1bc-488a-9fc9-2f247d9ee36c req-e7aa5b85-d202-4c03-9aea-65d12ea4ef1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f163048d-3c8a-4f40-bbdd-812146060e40", "tag": "c8ef0e82-0380-4d76-809e-a039ecf87b37"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:50.380299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a20814d6-a1bc-488a-9fc9-2f247d9ee36c req-e7aa5b85-d202-4c03-9aea-65d12ea4ef1d service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:50.380904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a20814d6-a1bc-488a-9fc9-2f247d9ee36c req-e7aa5b85-d202-4c03-9aea-65d12ea4ef1d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:50.381465 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-a20814d6-a1bc-488a-9fc9-2f247d9ee36c req-e7aa5b85-d202-4c03-9aea-65d12ea4ef1d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:50.385379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=100 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:50.393224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-a20814d6-a1bc-488a-9fc9-2f247d9ee36c req-e7aa5b85-d202-4c03-9aea-65d12ea4ef1d service nova] Creating event network-changed:c8ef0e82-0380-4d76-809e-a039ecf87b37 for instance f163048d-3c8a-4f40-bbdd-812146060e40 on hv-cinder-77923 Oct 20 14:48:50.398334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-a20814d6-a1bc-488a-9fc9-2f247d9ee36c req-e7aa5b85-d202-4c03-9aea-65d12ea4ef1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032921 Oct 20 14:48:50.398932 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 460/940] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:48:50.497248 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:50.497855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:50.504960 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:50.505446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:50.505899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:50.506589 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:50.507041 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:50.507464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:50.635855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:50.643762 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5909a00a-8c11-42ec-a70a-7f093080e677 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1450 microversion: 2.1 time: 0.150374 Oct 20 14:48:50.644318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 481/941] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:50 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:50.666688 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:50.667393 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:50.674093 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:50.674578 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:50.675017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:50.675716 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:50.676176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:50.676630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:50.811252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:50.819016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-2b0280e8-6fb7-4f71-8b29-10203c7dd99a tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1450 microversion: 2.1 time: 0.156564 Oct 20 14:48:50.819579 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 461/942] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:50 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:51.136851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:51.137459 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:51.144200 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:51.144798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:51.145371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:51.146075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:51.146641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:51.147055 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:51.161655 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:51.163159 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:51.170148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:51.170747 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:51.171278 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:51.172160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:51.173236 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:51.173363 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:51.379918 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:51.389638 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4a099ce8-8992-40bc-9fc6-74ea95d07d22 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.254879 Oct 20 14:48:51.393827 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 482/943] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:51 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:51.399419 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:51.409081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9eedb556-1215-465b-9847-4e970dbae490 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1468 microversion: 2.1 time: 0.251308 Oct 20 14:48:51.410268 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 462/944] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:51 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1468 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:52.430183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:52.430796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:52.437466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:52.438324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:52.438918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:52.439539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:52.439802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:52.440713 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:52.441324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:52.441906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:52.447263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:52.448130 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:52.448894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:52.449791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:52.450451 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:52.451018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:52.756865 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:52.768078 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ca6d420f-425b-457f-ba90-846e09781459 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.342541 Oct 20 14:48:52.781298 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 483/945] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:52 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:52.802269 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:52.813962 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-71f04a34-78f7-42d1-975b-52126e3b5258 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1468 microversion: 2.1 time: 0.379848 Oct 20 14:48:52.815185 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 463/946] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:52 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1468 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:53.101811 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-d1edcd43-b8e8-48fe-bd84-1d4f53ec68eb req-d3fbd635-7ddb-4c47-9ed5-592953e268fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "44ab85d7-45bc-4859-b029-a13206dfa7c9", "name": "network-vif-deleted", "tag": "019654ca-916a-4872-bc03-b7224bb3ac8e"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:53.122413 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d1edcd43-b8e8-48fe-bd84-1d4f53ec68eb req-d3fbd635-7ddb-4c47-9ed5-592953e268fd service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:53.122856 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d1edcd43-b8e8-48fe-bd84-1d4f53ec68eb req-d3fbd635-7ddb-4c47-9ed5-592953e268fd service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:53.123288 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d1edcd43-b8e8-48fe-bd84-1d4f53ec68eb req-d3fbd635-7ddb-4c47-9ed5-592953e268fd service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:53.161477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-d1edcd43-b8e8-48fe-bd84-1d4f53ec68eb req-d3fbd635-7ddb-4c47-9ed5-592953e268fd service nova] Creating event network-vif-deleted:019654ca-916a-4872-bc03-b7224bb3ac8e for instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 on hv-cinder-77923 Oct 20 14:48:53.168573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-d1edcd43-b8e8-48fe-bd84-1d4f53ec68eb req-d3fbd635-7ddb-4c47-9ed5-592953e268fd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072019 Oct 20 14:48:53.169340 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 484/947] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:48:53.793156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:53.794387 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:53.801213 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:53.801909 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:53.802556 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:53.803266 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:53.803719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:53.804309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:53.839229 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:53.839939 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:53.847083 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:53.847759 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:53.848183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:53.849292 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:53.849901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:53.850478 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:53.886326 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:53.887069 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:53.887664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:53.888417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lazy-loading 'fault' on Instance uuid 44ab85d7-45bc-4859-b029-a13206dfa7c9 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:48:53.956651 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '182a86c0f20a4bd3bc7523cae7e829b3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '76c13daa80f7403298c110265b3539a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:53.969224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-394722bc-c4d4-4ce0-8d7d-9d9ac8223274 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 200 len: 1304 microversion: 2.1 time: 0.134542 Oct 20 14:48:53.970458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 485/948] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:53 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 1304 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:53.989745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:53.997525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d51605ff-be6c-43a9-aa2a-cdd81c5cacfd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.208077 Oct 20 14:48:53.998303 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 464/949] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:53 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:54.993956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:54.994644 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] [instance: 44ab85d7-45bc-4859-b029-a13206dfa7c9] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:55.002249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:55.002782 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:55.003289 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:55.004174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:55.004940 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:55.005662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:55.022346 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:55.023062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:55.023327 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] HTTP exception thrown: Instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 could not be found. Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Request method failure captured: Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 HTTP/1.1 Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV-_OWW-i4Cq0os7rhSDlBAKfjvvzzjhDqdQDcBg2JOueoKKP4UoRx4rIzb5kmOKTudML3ySyTTYdPDvINH6naS740HnZwO5divvkhv0WnawgtjRp9mh_lbAswF_k1RusNeq9GDXhp2tHnw7YFpN9jJDsS-Uwnnps-lGCxnnPVS7pMQ Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 76c13daa80f7403298c110265b3539a3 Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesNegativeTest-1326005539 Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:48:55.025399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_76c13daa80f7403298c110265b3539a3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/76c13daa80f7403298c110265b3539a3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76c13daa80f7403298c110265b3539a3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/76c13daa80f7403298c110265b3539a3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesNegativeTest-1326005539 Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 76c13daa80f7403298c110265b3539a3 Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesNegativeTest-1326005539 Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesNegativeTest-1326005539-project Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 182a86c0f20a4bd3bc7523cae7e829b3 Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesNegativeTest-1326005539-project Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 could not be found. Oct 20 14:48:55.026886 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '44ab85d7-45bc-4859-b029-a13206dfa7c9'} Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 could not be found. Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:48:55.027679 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 could not be found. Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 could not be found. Oct 20 14:48:55.029063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:48:55.030490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] Returning 404 to user: Instance 44ab85d7-45bc-4859-b029-a13206dfa7c9 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:48:55.030490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-52cc8dc9-a36d-4b63-ab8f-da51a8f26a88 tempest-VolumesNegativeTest-1326005539 tempest-VolumesNegativeTest-1326005539-project] 10.222.0.13 "GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9" status: 404 len: 111 microversion: 2.1 time: 0.036822 Oct 20 14:48:55.030490 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 486/950] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:54 2022] GET /compute/v2.1/servers/44ab85d7-45bc-4859-b029-a13206dfa7c9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:48:55.039231 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:55.039857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:55.040533 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:55.041391 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:55.042000 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:55.042555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:55.212274 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:55.222248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1db7048f-001d-44fa-839d-8c9115e09684 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.204848 Oct 20 14:48:55.223218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 465/951] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:55 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:48:55.249452 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-87eeab7b-3ebc-4f57-80c1-2ef278ce1ef3 req-58fd67b0-6bb5-47d2-94ea-367dc6e97827 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1625a58-d299-446e-81a2-4a623396811e", "tag": "f7f2b887-f376-4acb-bc3d-f1adb4222e6f"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:55.260202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-87eeab7b-3ebc-4f57-80c1-2ef278ce1ef3 req-58fd67b0-6bb5-47d2-94ea-367dc6e97827 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:55.260801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-87eeab7b-3ebc-4f57-80c1-2ef278ce1ef3 req-58fd67b0-6bb5-47d2-94ea-367dc6e97827 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:55.261243 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-87eeab7b-3ebc-4f57-80c1-2ef278ce1ef3 req-58fd67b0-6bb5-47d2-94ea-367dc6e97827 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:55.277684 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-87eeab7b-3ebc-4f57-80c1-2ef278ce1ef3 req-58fd67b0-6bb5-47d2-94ea-367dc6e97827 service nova] Creating event network-changed:f7f2b887-f376-4acb-bc3d-f1adb4222e6f for instance e1625a58-d299-446e-81a2-4a623396811e on hv-cinder-77923 Oct 20 14:48:55.285318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-87eeab7b-3ebc-4f57-80c1-2ef278ce1ef3 req-58fd67b0-6bb5-47d2-94ea-367dc6e97827 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039512 Oct 20 14:48:55.285924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 487/952] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:48:56.245539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:56.246147 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:56.252780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:56.257102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:56.258730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:56.259304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:56.259818 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:56.260561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:56.261030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:56.262302 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:56.500880 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:56.511583 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a7d45f97-d527-4da9-8294-7864291c2a45 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.268566 Oct 20 14:48:56.512403 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 466/953] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:56 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:57.535750 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:57.536570 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:57.538927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:57.544292 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:57.544885 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:57.545319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:57.546017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:57.546529 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:57.547074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:57.713197 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:57.722157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-62d9d594-10bf-4105-a8bf-8f6fbfdddd41 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.190784 Oct 20 14:48:57.722943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 488/954] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:57 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:57.964118 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-cdd4fdc3-2309-447c-9f2d-cc23d6f97a32 req-6c747286-2252-4fe1-bdea-72f9234ccf1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f163048d-3c8a-4f40-bbdd-812146060e40", "name": "network-vif-plugged", "status": "completed", "tag": "c8ef0e82-0380-4d76-809e-a039ecf87b37"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:48:57.983505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cdd4fdc3-2309-447c-9f2d-cc23d6f97a32 req-6c747286-2252-4fe1-bdea-72f9234ccf1b service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:57.984865 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cdd4fdc3-2309-447c-9f2d-cc23d6f97a32 req-6c747286-2252-4fe1-bdea-72f9234ccf1b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:57.985559 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-cdd4fdc3-2309-447c-9f2d-cc23d6f97a32 req-6c747286-2252-4fe1-bdea-72f9234ccf1b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:58.001625 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-cdd4fdc3-2309-447c-9f2d-cc23d6f97a32 req-6c747286-2252-4fe1-bdea-72f9234ccf1b service nova] Creating event network-vif-plugged:c8ef0e82-0380-4d76-809e-a039ecf87b37 for instance f163048d-3c8a-4f40-bbdd-812146060e40 on hv-cinder-77923 Oct 20 14:48:58.007801 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-cdd4fdc3-2309-447c-9f2d-cc23d6f97a32 req-6c747286-2252-4fe1-bdea-72f9234ccf1b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047243 Oct 20 14:48:58.008936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 467/955] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:48:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:48:58.749386 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:58.750586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:58.753503 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:58.764084 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:58.767123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:58.767123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:58.767123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:58.767123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:58.767485 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:58.931957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:48:58.942131 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-09fde842-e00c-46a2-8bb3-169c4ba5a3ce tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1319 microversion: 2.1 time: 0.198721 Oct 20 14:48:58.942950 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 489/956] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:58 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:48:59.968071 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:48:59.970112 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:48:59.976586 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:48:59.979515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:59.980411 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:59.981097 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:48:59.982052 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:48:59.982727 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:48:59.983387 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:00.143217 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:00.151505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-77573ddc-c567-4faf-a1fb-43bf0b51792e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1508 microversion: 2.1 time: 0.188116 Oct 20 14:49:00.153127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 468/957] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:48:59 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:07.795608 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-398187417", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "networks": [{"uuid": "7731be1c-62ca-4cd2-86f3-15429eae1730"}]}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:07.862510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] validate_networks() for [('7731be1c-62ca-4cd2-86f3-15429eae1730', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:49:08.228199 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:49:08.228664 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:49:08.229438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:49:08.229845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:49:08.230252 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:49:08.241347 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:08.241855 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:08.242291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:08.243034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:08.243492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:08.243915 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:08.262514 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Getting quotas for project 7bafa4c5aa6943f9a860f577c957f33d. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:49:08.266932 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Getting quotas for user 57c1b64154514e43aec44f21af65cff7 and project 7bafa4c5aa6943f9a860f577c957f33d. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:49:08.277933 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:49:08.280256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:49:08.330702 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-12682b8b-9185-432f-8edd-895bcc31136f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.540609 Oct 20 14:49:08.331283 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 490/958] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:49:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 542 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:49:08.347987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-42fd622d-510d-4862-90cb-6284c7afe299 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:08.349911 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-42fd622d-510d-4862-90cb-6284c7afe299 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:08.408774 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-42fd622d-510d-4862-90cb-6284c7afe299 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:08.415780 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-42fd622d-510d-4862-90cb-6284c7afe299 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1213 microversion: 2.1 time: 0.076338 Oct 20 14:49:08.416435 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 469/959] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:08 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1213 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:49:09.441600 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:09.442492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:09.450238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:09.451389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:09.452241 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:09.453414 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:09.454006 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:09.454445 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:09.537173 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:09.551091 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-629b8ac4-1f65-4b29-a413-abd6e41c47f1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1265 microversion: 2.1 time: 0.115417 Oct 20 14:49:09.551958 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 491/960] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:09 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1265 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:10.576930 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:10.577534 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:10.579426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=44 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:10.587661 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:10.588427 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:10.588887 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:10.589600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:10.590057 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:10.590482 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:10.748417 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:10.757600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-aedfcf87-cb57-411b-9084-db8f30aa8e26 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.185412 Oct 20 14:49:10.758440 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 470/961] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:10 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:11.230220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-c19f374d-1dbf-42e6-8f1f-efeac0978d97 req-1eb117cf-6da0-4a2a-bc0d-7ed817839e57 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "900ca6d9-96c5-4684-a281-b3a1d73fc9ca", "tag": "5c11bc95-b5db-42bf-8a32-c27cbdf68de5"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:11.243633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-c19f374d-1dbf-42e6-8f1f-efeac0978d97 req-1eb117cf-6da0-4a2a-bc0d-7ed817839e57 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:11.244900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-c19f374d-1dbf-42e6-8f1f-efeac0978d97 req-1eb117cf-6da0-4a2a-bc0d-7ed817839e57 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:11.245554 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-c19f374d-1dbf-42e6-8f1f-efeac0978d97 req-1eb117cf-6da0-4a2a-bc0d-7ed817839e57 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:11.258641 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-c19f374d-1dbf-42e6-8f1f-efeac0978d97 req-1eb117cf-6da0-4a2a-bc0d-7ed817839e57 service nova] Creating event network-changed:5c11bc95-b5db-42bf-8a32-c27cbdf68de5 for instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca on hv-cinder-77923 Oct 20 14:49:11.271560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-c19f374d-1dbf-42e6-8f1f-efeac0978d97 req-1eb117cf-6da0-4a2a-bc0d-7ed817839e57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046208 Oct 20 14:49:11.275681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 492/962] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:49:11.783050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:11.784515 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:11.793234 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:11.793947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:11.794574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:11.795318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:11.796472 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:11.796668 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:11.953971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:11.966857 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-03858b1f-f324-472b-ad5b-cb5445b19140 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.188631 Oct 20 14:49:11.968191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 471/963] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:11 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:12.991632 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:12.992494 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:12.998790 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:12.999889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:13.000304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:13.001016 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:13.001466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:13.001908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:13.139463 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:13.147186 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3366ef07-0a10-489a-98ed-46c326e6e025 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.160269 Oct 20 14:49:13.147748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 493/964] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:12 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:14.170562 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:14.171175 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:14.178388 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:14.178873 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:14.179341 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:14.180036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:14.180532 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:14.180961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:14.312094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:14.320675 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8bef7960-c732-4a57-8416-21ad7351d84a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.153948 Oct 20 14:49:14.321259 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 472/965] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:14 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:15.343222 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:15.344195 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:15.351428 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:15.352157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:15.352616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:15.353314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:15.353762 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:15.354310 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:15.486785 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:15.494727 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c01fb694-19e3-4ba5-b940-8b7dee9d5852 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.155503 Oct 20 14:49:15.495278 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 494/966] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:15 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:16.519722 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:16.520377 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:16.526574 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:16.527062 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:16.527535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:16.528406 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:16.528889 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:16.529331 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:16.667157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:16.674193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d9da3582-6817-4394-b808-390b3d0b63ac tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.159013 Oct 20 14:49:16.675178 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 473/967] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:16 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:16.679956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23b5f5e5-e138-49f1-9635-29bf5404d6b7", "device": "/dev/sdb"}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:16.682874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:16.689818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:16.690324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:16.690737 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:16.691541 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:16.692118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:16.692851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:16.937047 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0605a0f6-d18c-4b29-9b63-3ce46d815395 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "POST /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260959 Oct 20 14:49:16.938491 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 495/968] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:49:16 2022] POST /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:49:17.698862 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:17.699464 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:17.707039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:17.707517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:17.707985 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:17.708695 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:17.709195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:17.709565 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:17.840714 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:17.848991 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f9b90db8-6cc4-4695-ab38-fa36b3635a85 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.155234 Oct 20 14:49:17.849559 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 474/969] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:17 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:18.048213 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-092b196b-3c7c-4177-b8bc-338c61d3cadc req-e86fc228-a41e-494b-924c-fc52c4f1db47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900ca6d9-96c5-4684-a281-b3a1d73fc9ca", "name": "network-vif-plugged", "status": "completed", "tag": "5c11bc95-b5db-42bf-8a32-c27cbdf68de5"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:18.066269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-092b196b-3c7c-4177-b8bc-338c61d3cadc req-e86fc228-a41e-494b-924c-fc52c4f1db47 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:18.066756 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-092b196b-3c7c-4177-b8bc-338c61d3cadc req-e86fc228-a41e-494b-924c-fc52c4f1db47 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:18.067188 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-092b196b-3c7c-4177-b8bc-338c61d3cadc req-e86fc228-a41e-494b-924c-fc52c4f1db47 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:18.071587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:18.080841 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-092b196b-3c7c-4177-b8bc-338c61d3cadc req-e86fc228-a41e-494b-924c-fc52c4f1db47 service nova] Creating event network-vif-plugged:5c11bc95-b5db-42bf-8a32-c27cbdf68de5 for instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca on hv-cinder-77923 Oct 20 14:49:18.087492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-092b196b-3c7c-4177-b8bc-338c61d3cadc req-e86fc228-a41e-494b-924c-fc52c4f1db47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044406 Oct 20 14:49:18.088313 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 496/970] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:49:18.873389 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:18.873909 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:18.876469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:18.882938 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:18.883426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:18.883856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:18.884581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:18.885021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:18.885443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:19.019014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:19.026879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ee2266f2-3f5d-44aa-a77d-bc74a3373b47 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1313 microversion: 2.1 time: 0.157391 Oct 20 14:49:19.027458 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 475/971] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:18 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:20.051744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:20.053021 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:20.055462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:20.056144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:20.063708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:20.064202 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:20.064673 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:20.065375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:20.065830 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:20.066252 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:20.203210 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:20.211565 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4a7991ae-4b8b-440f-ba05-1772080607c8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1497 microversion: 2.1 time: 0.165043 Oct 20 14:49:20.212294 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 497/972] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:20 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1497 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:20.700454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:20.700982 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:20.707438 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:20.707918 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:20.708371 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:20.709744 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:20.710200 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:20.710619 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:20.738203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:49:20.815115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-196752dc-f396-4324-8d17-0506d5e2376d tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "DELETE /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 204 len: 0 microversion: 2.1 time: 0.118325 Oct 20 14:49:20.815709 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 476/973] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:49:20 2022] DELETE /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:49:20.825563 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:20.826181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:20.833111 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:20.833650 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:20.834178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:20.834787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:20.835245 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:20.835670 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:20.968123 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:20.976058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-5688618a-621a-46e6-b7f3-1e116c7088b9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1503 microversion: 2.1 time: 0.154553 Oct 20 14:49:20.976736 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 498/974] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:20 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:22.001968 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:22.002944 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:22.011334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:22.011824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:22.012252 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:22.012979 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:22.013428 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:22.013847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:22.151067 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:22.158913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-84d9e3dd-c2c3-4cbb-bd79-12972f3b75e7 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1503 microversion: 2.1 time: 0.163522 Oct 20 14:49:22.159487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 477/975] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:21 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1503 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:22.778385 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-ade3b580-286a-46b1-bf9b-bc2e9925ef84 req-9d9c2a9e-410a-4997-b32f-6a6c4de3ad36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "900ca6d9-96c5-4684-a281-b3a1d73fc9ca", "name": "network-vif-deleted", "tag": "5c11bc95-b5db-42bf-8a32-c27cbdf68de5"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:22.788564 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-ade3b580-286a-46b1-bf9b-bc2e9925ef84 req-9d9c2a9e-410a-4997-b32f-6a6c4de3ad36 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:22.789037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-ade3b580-286a-46b1-bf9b-bc2e9925ef84 req-9d9c2a9e-410a-4997-b32f-6a6c4de3ad36 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:22.789458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-ade3b580-286a-46b1-bf9b-bc2e9925ef84 req-9d9c2a9e-410a-4997-b32f-6a6c4de3ad36 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:22.800066 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-ade3b580-286a-46b1-bf9b-bc2e9925ef84 req-9d9c2a9e-410a-4997-b32f-6a6c4de3ad36 service nova] Creating event network-vif-deleted:5c11bc95-b5db-42bf-8a32-c27cbdf68de5 for instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca on hv-cinder-77923 Oct 20 14:49:22.805492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-ade3b580-286a-46b1-bf9b-bc2e9925ef84 req-9d9c2a9e-410a-4997-b32f-6a6c4de3ad36 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030814 Oct 20 14:49:22.806115 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 499/976] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:49:23.182011 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:23.182630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:23.189063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:23.189545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:23.189979 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:23.190677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:23.191120 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:23.191544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:23.222550 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:23.223031 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:23.223465 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:23.223906 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lazy-loading 'fault' on Instance uuid 900ca6d9-96c5-4684-a281-b3a1d73fc9ca {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:49:23.265134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:23.273657 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e1900776-98fa-4018-8385-04b2726d4732 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 200 len: 1303 microversion: 2.1 time: 0.095524 Oct 20 14:49:23.274223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 478/977] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:23 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 1303 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:24.297621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:24.298309 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 900ca6d9-96c5-4684-a281-b3a1d73fc9ca] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:24.304464 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:24.304943 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:24.305371 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:24.306081 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:24.306528 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:24.306945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:24.320379 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] HTTP exception thrown: Instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca could not be found. Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Request method failure captured: Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca HTTP/1.1 Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV_hNZ0CcpY2ZziYEyFcKQbwfbkClb87XpyStEjNYpqIwOSp3iBTL9wEbmXeKsg-x33uNMPJQKeDXtyT7sXmoRn5d_JTALJKn384HHSWtiDUNn_IyUegtB0azDaj_FyHcMNPARTLZIE7rlWVehPBILwZ_juMSanoUtjjAxenQ2IQUwQ Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 7bafa4c5aa6943f9a860f577c957f33d Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesActionsTest-530097731 Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:49:24.321972 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesActionsTest-530097731 Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 7bafa4c5aa6943f9a860f577c957f33d Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesActionsTest-530097731 Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesActionsTest-530097731-project Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 57c1b64154514e43aec44f21af65cff7 Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesActionsTest-530097731-project Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca could not be found. Oct 20 14:49:24.323724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '900ca6d9-96c5-4684-a281-b3a1d73fc9ca'} Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca could not be found. Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:49:24.324717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca could not be found. Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca could not be found. Oct 20 14:49:24.326314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:24.327658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Returning 404 to user: Instance 900ca6d9-96c5-4684-a281-b3a1d73fc9ca could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:49:24.327658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fab50fa4-aaf6-4f32-8616-52508c15dc92 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca" status: 404 len: 111 microversion: 2.1 time: 0.030485 Oct 20 14:49:24.327658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 500/978] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:24 2022] GET /compute/v2.1/servers/900ca6d9-96c5-4684-a281-b3a1d73fc9ca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:49:24.419730 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-43061854", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "networks": [{"uuid": "7731be1c-62ca-4cd2-86f3-15429eae1730"}]}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:24.476165 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.network.neutron [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] validate_networks() for [('7731be1c-62ca-4cd2-86f3-15429eae1730', None, None, None, None, None)] {{(pid=125810) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:49:25.099757 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Flavor limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:49:25.100186 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Image limits 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:49:25.100692 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Flavor pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:49:25.101105 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Image pref 0:0:0 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:49:25.101519 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.virt.hardware [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125810) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:49:25.110792 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:25.111275 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:25.111708 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:25.112468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:25.112922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:25.113348 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:25.130044 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Getting quotas for project 7bafa4c5aa6943f9a860f577c957f33d. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:49:25.134951 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.quota [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Getting quotas for user 57c1b64154514e43aec44f21af65cff7 and project 7bafa4c5aa6943f9a860f577c957f33d. Resources: {'ram', 'cores', 'instances'} {{(pid=125810) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:49:25.145633 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Going to run 1 instances... {{(pid=125810) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:49:25.148959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125810) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:49:25.195676 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b069825b-05a7-4c0a-accf-f4fb353e0396 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.779708 Oct 20 14:49:25.196453 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 479/979] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:49:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 781 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 20 14:49:25.207351 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-46c4283c-fdf2-4b0c-9c74-b536b8bec2aa tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:25.207963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-46c4283c-fdf2-4b0c-9c74-b536b8bec2aa tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:25.261801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-46c4283c-fdf2-4b0c-9c74-b536b8bec2aa tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:25.268535 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-46c4283c-fdf2-4b0c-9c74-b536b8bec2aa tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1212 microversion: 2.1 time: 0.065026 Oct 20 14:49:25.269223 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 501/980] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:25 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1212 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:26.292336 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:26.292917 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:26.299510 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:26.299996 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:26.300461 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:26.301165 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:26.301623 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:26.302084 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:26.368040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:26.375824 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e022c0cf-f74a-4ba8-8ad2-254db4bfd492 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1216 microversion: 2.1 time: 0.088040 Oct 20 14:49:26.376410 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 480/981] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:26 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1216 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:27.399470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:27.400080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:27.409442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:27.409924 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:27.410357 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:27.411048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:27.411565 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:27.412070 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:27.470914 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:27.478988 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ea37ddbf-53ea-4126-8151-f1a6d24f827a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1208 microversion: 2.1 time: 0.084106 Oct 20 14:49:27.479543 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 502/982] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:27 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1208 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:28.501715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:28.502340 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:28.505832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 20 14:49:28.505993 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Thu Oct 20 14:49:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 (ip 10.222.0.13) !!! Oct 20 14:49:28.513386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:28.513875 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:28.514316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:28.515018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:28.515473 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:28.515896 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:28.579127 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:28.587381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c25e1b8c-3a1e-44c5-a081-9fae37f497d4 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1264 microversion: 2.1 time: 0.089484 Oct 20 14:49:28.587954 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 481/983] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:28 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1264 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:29.610475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:29.611805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:29.622709 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:29.627392 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:29.627879 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:29.629050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:29.629752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:29.630730 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:29.631245 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:29.762049 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:29.769858 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3de0be4c-72c8-4ed2-9695-bd89f3395bf1 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.163613 Oct 20 14:49:29.770430 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 503/984] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:29 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:30.794166 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:30.794779 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:30.797154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:30.802796 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:30.803281 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:30.803721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:30.804444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:30.804904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:30.805331 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:30.936392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:30.944391 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a6dfe4ca-97f5-4582-9cc6-41c79c3cd998 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.154138 Oct 20 14:49:30.944962 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 482/985] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:30 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:31.967851 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:31.968472 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:31.975614 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:31.976093 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:31.976828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:31.977508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:31.977956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:31.978373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:32.109466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:32.117372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-79407fb1-7273-4a22-b6b8-8e39f5c8c15a tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.153354 Oct 20 14:49:32.117945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 504/986] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:31 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:33.062603 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-eb9b998e-71c6-4e84-b15b-d94cc33ff778 req-3790e9ec-733d-4331-b29a-0bd0c0d97cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "000518c2-ff55-46a2-9518-caed12f490e5", "tag": "6f8a072e-2539-4192-a43d-c72827144547"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:33.077206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-eb9b998e-71c6-4e84-b15b-d94cc33ff778 req-3790e9ec-733d-4331-b29a-0bd0c0d97cd8 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:33.077699 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-eb9b998e-71c6-4e84-b15b-d94cc33ff778 req-3790e9ec-733d-4331-b29a-0bd0c0d97cd8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:33.078704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-eb9b998e-71c6-4e84-b15b-d94cc33ff778 req-3790e9ec-733d-4331-b29a-0bd0c0d97cd8 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:33.095598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-eb9b998e-71c6-4e84-b15b-d94cc33ff778 req-3790e9ec-733d-4331-b29a-0bd0c0d97cd8 service nova] Creating event network-changed:6f8a072e-2539-4192-a43d-c72827144547 for instance 000518c2-ff55-46a2-9518-caed12f490e5 on hv-cinder-77923 Oct 20 14:49:33.103206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-eb9b998e-71c6-4e84-b15b-d94cc33ff778 req-3790e9ec-733d-4331-b29a-0bd0c0d97cd8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045013 Oct 20 14:49:33.104364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 483/987] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:49:33.139373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:33.139983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:33.147206 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:33.147691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:33.148390 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:33.149579 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:33.150275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:33.150963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:33.306712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:33.316444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-00389e20-618d-4f4c-88d2-c8ff092c03c9 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.181119 Oct 20 14:49:33.317094 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 505/988] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:33 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:34.347277 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:34.347987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:34.355851 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:34.357214 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:34.357690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:34.358577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:34.359161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:34.359508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:34.491854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:34.501015 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d70a097b-4148-40a5-9a2a-d3863c942ccb tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.158289 Oct 20 14:49:34.501577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 484/989] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:34 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:35.523982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:35.524697 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:35.526990 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:35.532462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:35.532941 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:35.533372 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:35.534059 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:35.534512 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:35.534933 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:35.669140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:35.677722 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ae119c39-fe81-49fa-a379-7a4ceafa2f28 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.157570 Oct 20 14:49:35.678286 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 506/990] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:35 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:36.700383 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:36.701002 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:36.702942 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:36.703607 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=6 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:36.710486 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:36.710969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:36.711537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:36.712195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:36.712757 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:36.713184 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:36.844872 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:36.848280 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:36.853998 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5470b210-90c1-4aba-a334-b66474e2a119 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.157492 Oct 20 14:49:36.854563 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 485/991] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:36 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:37.877633 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:37.878183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:37.885354 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:37.885845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:37.886319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:37.887264 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:37.887478 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:37.887906 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:38.021646 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:38.029991 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-4b807ce1-1b2c-413b-bc22-fdcf4a5970a3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.155798 Oct 20 14:49:38.030573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 507/992] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:37 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:39.053500 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:39.054128 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:39.061271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:39.061754 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:39.062395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:39.063255 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:39.063869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:39.064290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:39.199414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:39.207401 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dea7090f-c732-4801-938a-db9d02d7a23e tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.158294 Oct 20 14:49:39.209039 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 486/993] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:39 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:40.231185 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:40.231805 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:40.238315 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:40.239375 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:40.239814 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:40.240531 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:40.241005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:40.241455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:40.374125 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:40.382460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7cff5a6f-d821-48a4-9c1e-ae55ef046d17 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.155107 Oct 20 14:49:40.383037 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 508/994] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:40 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:40.631193 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-4e4abdce-a786-4a82-a19a-bf75e858324f req-45c3a457-8289-4374-b2ce-b0c4881d3cfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000518c2-ff55-46a2-9518-caed12f490e5", "name": "network-vif-plugged", "status": "completed", "tag": "6f8a072e-2539-4192-a43d-c72827144547"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:40.642111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4e4abdce-a786-4a82-a19a-bf75e858324f req-45c3a457-8289-4374-b2ce-b0c4881d3cfe service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:40.642743 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4e4abdce-a786-4a82-a19a-bf75e858324f req-45c3a457-8289-4374-b2ce-b0c4881d3cfe service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:40.643365 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-4e4abdce-a786-4a82-a19a-bf75e858324f req-45c3a457-8289-4374-b2ce-b0c4881d3cfe service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:40.658320 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-4e4abdce-a786-4a82-a19a-bf75e858324f req-45c3a457-8289-4374-b2ce-b0c4881d3cfe service nova] Creating event network-vif-plugged:6f8a072e-2539-4192-a43d-c72827144547 for instance 000518c2-ff55-46a2-9518-caed12f490e5 on hv-cinder-77923 Oct 20 14:49:40.664794 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-4e4abdce-a786-4a82-a19a-bf75e858324f req-45c3a457-8289-4374-b2ce-b0c4881d3cfe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038029 Oct 20 14:49:40.665431 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 487/995] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:49:40.793277 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:40.793849 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:40.800233 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:40.800783 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:40.801282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:40.802000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:40.802460 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:40.802891 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:40.888567 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lazy-loading 'services' on Instance uuid f163048d-3c8a-4f40-bbdd-812146060e40 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:49:40.960220 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c3c9441d-49f0-4efc-af61-01d85262b227 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40/os-volume_attachments/23b5f5e5-e138-49f1-9635-29bf5404d6b7" status: 202 len: 0 microversion: 2.1 time: 0.171091 Oct 20 14:49:40.960875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 509/996] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:49:40 2022] DELETE /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40/os-volume_attachments/23b5f5e5-e138-49f1-9635-29bf5404d6b7 => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:49:41.406028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:41.406721 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:41.413390 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:41.413869 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:41.414300 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:41.414977 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:41.415426 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:41.415842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:41.542852 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:41.550444 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fc6fbca7-5127-4012-96f4-71e3150dcbd8 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.148627 Oct 20 14:49:41.551013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 488/997] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:41 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:42.574013 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:42.574746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:42.580944 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:42.581433 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:42.581874 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:42.583061 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:42.583556 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:42.584269 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:42.713548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:42.721141 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-56d508b8-c45b-4a67-8576-e2aa42c4bce6 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.151920 Oct 20 14:49:42.721708 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 510/998] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:42 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:43.745075 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:43.746342 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:43.752981 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:43.753463 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:43.753890 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:43.754789 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:43.755140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:43.755564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:43.886566 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:43.894225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-53f71059-1780-47cd-8b31-df5134633f3f tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.153200 Oct 20 14:49:43.894783 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 489/999] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:43 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:44.918726 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:44.920404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:44.929474 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:44.930275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:44.930990 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:44.932506 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:44.933211 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:44.933707 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:45.072658 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:45.080752 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1e3860e0-7b76-4836-a74b-4ec8e452c8a2 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1312 microversion: 2.1 time: 0.166683 Oct 20 14:49:45.081435 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 511/1000] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:44 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1312 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:45.265179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:45.265740 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:45.272892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:45.273378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:45.273813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:45.274523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:45.275050 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:45.275530 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:45.305102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:49:45.389528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7450d9ab-316e-4f5c-a7bb-af95985ba6d6 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "DELETE /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 204 len: 0 microversion: 2.1 time: 0.127872 Oct 20 14:49:45.390115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 490/1001] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:49:45 2022] DELETE /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:49:45.398637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:45.399249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:45.406257 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:45.406818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:45.407248 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:45.407923 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:45.408427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:45.408881 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:45.548540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:45.557456 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c4f99925-789d-4003-b333-b5911a34e7a1 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1560 microversion: 2.1 time: 0.163082 Oct 20 14:49:45.558022 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 512/1002] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:45 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:46.106258 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:46.106958 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:46.112893 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.113379 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.114640 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.115334 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.115791 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.116216 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.246154 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:46.253810 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e661b741-5e68-47dd-851c-df40cf5ff646 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1495 microversion: 2.1 time: 0.152228 Oct 20 14:49:46.254602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 491/1003] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:46 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1495 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:46.581446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:46.582936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:46.589613 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.590096 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.590546 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.592434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.593108 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.594061 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.732890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:46.741408 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ea84107e-e5fe-4cb3-b851-0f457f910bcf tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1514 microversion: 2.1 time: 0.163902 Oct 20 14:49:46.741975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 513/1004] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:46 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1514 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:46.792487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:46.793013 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:46.799028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.799503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.799930 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.800653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.801132 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.801665 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.826715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:49:46.904658 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b39bb25b-ac7e-4a36-b971-cf87a5c70146 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "DELETE /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 204 len: 0 microversion: 2.1 time: 0.115736 Oct 20 14:49:46.905517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 492/1005] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:49:46 2022] DELETE /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:49:46.914234 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:46.914848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:46.921142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.921809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.922149 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:46.922864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:46.923318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:46.923741 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:47.052056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:47.059678 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ae868ed5-51b1-47a7-8b51-aa137b488cff tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1501 microversion: 2.1 time: 0.149947 Oct 20 14:49:47.060232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 514/1006] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:46 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1501 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:49:47.765553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:47.766279 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:47.773183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:47.773663 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:47.774090 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:47.774777 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:47.775225 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:47.775643 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:47.915467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:47.923171 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9e5afea6-4c9c-40b8-b22c-f5c41554e820 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1514 microversion: 2.1 time: 0.161784 Oct 20 14:49:47.923743 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 493/1007] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:47 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1514 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:48.084173 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:48.084945 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:48.091365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:48.091847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:48.092437 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:48.093158 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:48.093738 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:48.094186 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:48.099045 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:49:48.274181 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:48.282249 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-de38d1b2-2853-4360-bb89-3d725f0872ee tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1501 microversion: 2.1 time: 0.202856 Oct 20 14:49:48.282834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 515/1008] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:48 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1501 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:49:48.947613 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:48.948686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:48.955975 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:48.956576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:48.957839 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:48.958640 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:48.959173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:48.959666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:49.107999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:49.117218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e744cc83-d895-4ea6-8984-047c1776f54a tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1514 microversion: 2.1 time: 0.173746 Oct 20 14:49:49.117919 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 494/1009] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:48 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1514 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:49.305609 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:49.306832 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:49.312938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:49.313417 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:49.313846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:49.314533 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:49.314982 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:49.315400 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:49.466745 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '57c1b64154514e43aec44f21af65cff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bafa4c5aa6943f9a860f577c957f33d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:49.475916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3e1ae472-8c1b-4931-bfaf-528280182cda tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 200 len: 1501 microversion: 2.1 time: 0.174037 Oct 20 14:49:49.477748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 516/1010] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:49 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 1501 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:49.699630 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-97f6ade4-b436-472d-a6d0-e31b571184f0 req-22572ae9-6da8-4649-89f6-7ca3eb813a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "000518c2-ff55-46a2-9518-caed12f490e5", "name": "network-vif-deleted", "tag": "6f8a072e-2539-4192-a43d-c72827144547"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:49.722058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-97f6ade4-b436-472d-a6d0-e31b571184f0 req-22572ae9-6da8-4649-89f6-7ca3eb813a87 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:49.724085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-97f6ade4-b436-472d-a6d0-e31b571184f0 req-22572ae9-6da8-4649-89f6-7ca3eb813a87 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:49.724642 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-97f6ade4-b436-472d-a6d0-e31b571184f0 req-22572ae9-6da8-4649-89f6-7ca3eb813a87 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:49.749588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-97f6ade4-b436-472d-a6d0-e31b571184f0 req-22572ae9-6da8-4649-89f6-7ca3eb813a87 service nova] Creating event network-vif-deleted:6f8a072e-2539-4192-a43d-c72827144547 for instance 000518c2-ff55-46a2-9518-caed12f490e5 on hv-cinder-77923 Oct 20 14:49:49.756959 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-97f6ade4-b436-472d-a6d0-e31b571184f0 req-22572ae9-6da8-4649-89f6-7ca3eb813a87 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061859 Oct 20 14:49:49.758115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 495/1011] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:49:50.140575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:50.141189 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:50.147888 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:50.148404 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:50.148840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:50.149526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:50.149977 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:50.150399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:50.181784 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:50.182259 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:50.182768 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:50.183275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lazy-loading 'fault' on Instance uuid f163048d-3c8a-4f40-bbdd-812146060e40 {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:49:50.227786 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:49:50.235454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8b91c808-2182-4d57-8d8c-d36c60a14e21 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 200 len: 1309 microversion: 2.1 time: 0.098814 Oct 20 14:49:50.236012 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 517/1012] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:50 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 1309 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:49:50.501182 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:50.501879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] [instance: 000518c2-ff55-46a2-9518-caed12f490e5] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:50.508570 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:50.509049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:50.509481 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:50.510159 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:50.510602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:50.511016 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:50.525018 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] HTTP exception thrown: Instance 000518c2-ff55-46a2-9518-caed12f490e5 could not be found. Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Request method failure captured: Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 HTTP/1.1 Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV_hNZ0CcpY2ZziYEyFcKQbwfbkClb87XpyStEjNYpqIwOSp3iBTL9wEbmXeKsg-x33uNMPJQKeDXtyT7sXmoRn5d_JTALJKn384HHSWtiDUNn_IyUegtB0azDaj_FyHcMNPARTLZIE7rlWVehPBILwZ_juMSanoUtjjAxenQ2IQUwQ Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 7bafa4c5aa6943f9a860f577c957f33d Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesActionsTest-530097731 Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:49:50.526610 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/7bafa4c5aa6943f9a860f577c957f33d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesActionsTest-530097731 Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 7bafa4c5aa6943f9a860f577c957f33d Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesActionsTest-530097731 Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesActionsTest-530097731-project Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 57c1b64154514e43aec44f21af65cff7 Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesActionsTest-530097731-project Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 000518c2-ff55-46a2-9518-caed12f490e5 could not be found. Oct 20 14:49:50.528313 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '000518c2-ff55-46a2-9518-caed12f490e5'} Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 000518c2-ff55-46a2-9518-caed12f490e5 could not be found. Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:49:50.529344 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 000518c2-ff55-46a2-9518-caed12f490e5 could not be found. Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 000518c2-ff55-46a2-9518-caed12f490e5 could not be found. Oct 20 14:49:50.530956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:49:50.532364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] Returning 404 to user: Instance 000518c2-ff55-46a2-9518-caed12f490e5 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:49:50.532364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1199f490-c939-474b-9c90-6af8cb700dc3 tempest-VolumesActionsTest-530097731 tempest-VolumesActionsTest-530097731-project] 10.222.0.13 "GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5" status: 404 len: 111 microversion: 2.1 time: 0.031466 Oct 20 14:49:50.532364 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 496/1013] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:50 2022] GET /compute/v2.1/servers/000518c2-ff55-46a2-9518-caed12f490e5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 14:49:51.258842 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:49:51.259448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: f163048d-3c8a-4f40-bbdd-812146060e40] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:49:51.266716 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:51.267169 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:51.267800 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:51.268524 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:51.269213 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:51.269787 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:51.290208 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] HTTP exception thrown: Instance f163048d-3c8a-4f40-bbdd-812146060e40 could not be found. Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Request method failure captured: Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 HTTP/1.1 Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV_LetO6c1r7iCjvOIz4tkFBFYSykUiZRCd8Iuz4CLP07V2GQYYptqWN7D9z1vF2A5tT5OcJ0l3_FX6JR8u720lCps_-3Mxbh0f4EKmjpwZ4gUiXFV-zl4Zbx2maMRbvJoO1U3IfG1hL4CDV2X9JiNmBgiB503faFvCn2Ba1R4mHfOM Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: 34676c921ba04710b14cfa94eab069d3 Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1279269068 Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:49:51.291929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_34676c921ba04710b14cfa94eab069d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/34676c921ba04710b14cfa94eab069d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34676c921ba04710b14cfa94eab069d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34676c921ba04710b14cfa94eab069d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-VolumesSnapshotTestJSON-1279269068 Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: 34676c921ba04710b14cfa94eab069d3 Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1279269068 Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-VolumesSnapshotTestJSON-1279269068-project Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: 36a281f7f9c8435c8ad65ae4b0bf141a Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-VolumesSnapshotTestJSON-1279269068-project Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance f163048d-3c8a-4f40-bbdd-812146060e40 could not be found. Oct 20 14:49:51.293510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': 'f163048d-3c8a-4f40-bbdd-812146060e40'} Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f163048d-3c8a-4f40-bbdd-812146060e40 could not be found. Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:49:51.294349 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f163048d-3c8a-4f40-bbdd-812146060e40 could not be found. Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f163048d-3c8a-4f40-bbdd-812146060e40 could not be found. Oct 20 14:49:51.295672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:49:51.298661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Returning 404 to user: Instance f163048d-3c8a-4f40-bbdd-812146060e40 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:49:51.298661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-10b1bdd5-7eed-4ffa-ad9f-999ff57863fd tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40" status: 404 len: 111 microversion: 2.1 time: 0.038755 Oct 20 14:49:51.306133 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 518/1014] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:49:51 2022] GET /compute/v2.1/servers/f163048d-3c8a-4f40-bbdd-812146060e40 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:49:51.772999 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-3f835dbd-024c-4ac3-b886-2d052f863095 req-74caf08e-de7e-4e43-adfc-36c41e799ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f163048d-3c8a-4f40-bbdd-812146060e40", "name": "network-vif-deleted", "tag": "c8ef0e82-0380-4d76-809e-a039ecf87b37"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:49:51.782783 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3f835dbd-024c-4ac3-b886-2d052f863095 req-74caf08e-de7e-4e43-adfc-36c41e799ae2 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:49:51.783260 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3f835dbd-024c-4ac3-b886-2d052f863095 req-74caf08e-de7e-4e43-adfc-36c41e799ae2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:49:51.783692 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-3f835dbd-024c-4ac3-b886-2d052f863095 req-74caf08e-de7e-4e43-adfc-36c41e799ae2 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:49:51.797323 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-3f835dbd-024c-4ac3-b886-2d052f863095 req-74caf08e-de7e-4e43-adfc-36c41e799ae2 service nova] Creating event network-vif-deleted:c8ef0e82-0380-4d76-809e-a039ecf87b37 for instance f163048d-3c8a-4f40-bbdd-812146060e40 on hv-cinder-77923 Oct 20 14:49:51.802623 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-3f835dbd-024c-4ac3-b886-2d052f863095 req-74caf08e-de7e-4e43-adfc-36c41e799ae2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033484 Oct 20 14:49:51.803195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 497/1015] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:50:03.302511 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:03.305408 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:03.309942 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=33 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:03.310749 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=20 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:03.319936 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:03.320466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:03.320912 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:03.321626 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:03.322085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:03.322516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:03.362365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lazy-loading 'flavor' on Instance uuid a4919bb2-0fa7-455d-bb9e-55db2807713c {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:50:03.441238 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-ea4b59da-ce17-4d3b-b5a0-b31b29e43d18 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "POST /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c/action" status: 202 len: 0 microversion: 2.1 time: 0.142982 Oct 20 14:50:03.442102 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 519/1016] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:50:03 2022] POST /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c/action => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:50:03.451456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:03.452539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:03.458230 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:03.460085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:03.472188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:03.472994 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:03.473628 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:03.474502 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:03.475711 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:03.476508 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:03.675786 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:03.684248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-683459f3-3d74-45a4-8c69-d2a7b9f9c902 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.236013 Oct 20 14:50:03.684845 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 498/1017] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:03 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:04.496616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1982901935", "imageRef": "43c6a3f1-716e-4074-ac81-59f859f9329f", "flavorRef": "452", "networks": [{"uuid": "92c1189e-ce15-4ec8-b1e7-06403b47c306"}]}} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:04.552073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.network.neutron [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] validate_networks() for [('92c1189e-ce15-4ec8-b1e7-06403b47c306', None, None, None, None, None)] {{(pid=125811) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 20 14:50:04.711825 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:04.713223 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:04.723157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:04.724179 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:04.725381 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:04.727044 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:04.727877 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:04.728524 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:04.978049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:04.988604 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-11a34263-1645-4109-b69e-50aa58c33f45 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.281514 Oct 20 14:50:05.001415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 499/1018] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:04 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:05.025864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Flavor limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 20 14:50:05.026569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Image limits 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 20 14:50:05.027196 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Flavor pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 20 14:50:05.027744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Image pref 0:0:0 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 20 14:50:05.028362 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.virt.hardware [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=125811) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 20 14:50:05.042994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:05.043733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:05.044303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:05.045293 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:05.046109 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:05.047056 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:05.071764 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Getting quotas for project 34676c921ba04710b14cfa94eab069d3. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 20 14:50:05.079354 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.quota [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Getting quotas for user 36a281f7f9c8435c8ad65ae4b0bf141a and project 34676c921ba04710b14cfa94eab069d3. Resources: {'ram', 'cores', 'instances'} {{(pid=125811) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 20 14:50:05.095391 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Going to run 1 instances... {{(pid=125811) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 20 14:50:05.097847 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='43c6a3f1-716e-4074-ac81-59f859f9329f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=125811) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 20 14:50:05.152937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9e9c3f77-6a55-4c70-bbc0-e4b98bcc00fe tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664076 Oct 20 14:50:05.153783 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 520/1019] 10.222.0.13 () {60 vars in 1147 bytes} [Thu Oct 20 14:50:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 20 14:50:05.177629 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8933e562-74cc-46b9-9f1f-1d3ddb8b6f31 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:05.187888 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8933e562-74cc-46b9-9f1f-1d3ddb8b6f31 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:05.246772 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8933e562-74cc-46b9-9f1f-1d3ddb8b6f31 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:05.253913 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8933e562-74cc-46b9-9f1f-1d3ddb8b6f31 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1219 microversion: 2.1 time: 0.091474 Oct 20 14:50:05.254483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 500/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:05 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:06.014270 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:06.014954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:06.023265 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:06.023825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:06.024363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:06.025124 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:06.025742 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:06.026227 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:06.172504 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:06.182224 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6101e781-18e6-4dd2-93a0-ae3e74f87d44 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.171810 Oct 20 14:50:06.183175 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 521/1021] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:06 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:06.284299 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:06.285518 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:06.293614 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:06.294104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:06.294752 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:06.295539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:06.296008 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:06.296487 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:06.376024 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:06.384816 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-1a4260d1-30db-4f0c-bccf-4352ec2e92a7 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1223 microversion: 2.1 time: 0.104395 Oct 20 14:50:06.396415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 501/1022] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:06 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1223 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:07.207458 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:07.208434 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:07.215780 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:07.216262 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:07.216724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:07.217411 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:07.218033 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:07.218616 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:07.393661 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:07.404337 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cb0db49f-06ac-48f8-a724-98e3fe3b3ca0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.201528 Oct 20 14:50:07.405470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 522/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:07 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:07.409799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:07.410577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:07.421686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:07.422191 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:07.422637 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:07.425043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:07.425667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:07.426221 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:07.499321 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:07.508823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-161e30d9-2351-41c2-ad35-6568571274a9 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1223 microversion: 2.1 time: 0.102918 Oct 20 14:50:07.509901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 502/1024] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:07 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1223 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:08.432150 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:08.440519 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:08.462587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:08.463804 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:08.464405 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:08.465142 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:08.465596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:08.471465 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:08.533040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:08.534264 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:08.551596 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:08.553318 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:08.554145 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:08.555424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:08.556043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:08.557472 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:08.666142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:08.684677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-214ec80f-50db-49c3-a3c6-f65ee5eb0ae4 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1271 microversion: 2.1 time: 0.155066 Oct 20 14:50:08.685552 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:08.686831 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 503/1025] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:08 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1271 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:08.711937 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-db7e8340-ee66-42a5-89e6-0346c5a1e1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.285609 Oct 20 14:50:08.713154 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 523/1026] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:08 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:09.712787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:09.713641 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:09.726654 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:09.727150 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:09.727589 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:09.734021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:09.734837 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:09.739448 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:09.741114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:09.741396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:09.752585 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:09.754399 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:09.756286 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:09.758361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:09.759114 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:09.759956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:09.889466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:09.899445 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7548d291-6d60-427f-a0b4-af3c59ce8d19 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1277 microversion: 2.1 time: 0.191922 Oct 20 14:50:09.904949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 504/1027] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:09 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1277 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:10.012717 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:10.025744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3b0282b5-908c-436f-be79-b18f5df07557 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.290307 Oct 20 14:50:10.026840 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 524/1028] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:09 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:10.942942 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:10.947054 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:10.957243 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:10.958138 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:10.959032 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:10.960005 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:10.961148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:10.962576 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:11.054642 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:11.055265 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:11.081359 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:11.081996 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:11.082438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:11.083218 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:11.084157 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:11.084920 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:11.248770 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:11.257079 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-930168af-50d0-495b-ba8f-4d5fa9960be2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1319 microversion: 2.1 time: 0.329745 Oct 20 14:50:11.257653 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 505/1029] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:10 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:11.334140 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:11.343834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f45c1552-c61e-4922-9911-f3f9cc0a47d9 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.293738 Oct 20 14:50:11.352255 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 525/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:11 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:11.520049 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-089ec1d1-deb6-455b-aac1-510bc88aee33 req-e231811c-7b0c-498c-ad61-3387795b19ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "18ec81db-0fa4-4b40-87a9-c4b86ed64dfa", "tag": "5b20a1ef-f714-4bf8-87d3-8b2cd39905eb"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:11.541538 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-089ec1d1-deb6-455b-aac1-510bc88aee33 req-e231811c-7b0c-498c-ad61-3387795b19ed service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:11.542176 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-089ec1d1-deb6-455b-aac1-510bc88aee33 req-e231811c-7b0c-498c-ad61-3387795b19ed service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:11.542830 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-089ec1d1-deb6-455b-aac1-510bc88aee33 req-e231811c-7b0c-498c-ad61-3387795b19ed service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:11.579034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-089ec1d1-deb6-455b-aac1-510bc88aee33 req-e231811c-7b0c-498c-ad61-3387795b19ed service nova] Creating event network-changed:5b20a1ef-f714-4bf8-87d3-8b2cd39905eb for instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa on hv-cinder-77923 Oct 20 14:50:11.586558 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-089ec1d1-deb6-455b-aac1-510bc88aee33 req-e231811c-7b0c-498c-ad61-3387795b19ed service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075575 Oct 20 14:50:11.586911 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 506/1031] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:50:12.280397 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:12.281754 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:12.290332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:12.291160 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:12.291635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:12.292624 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:12.293097 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:12.293521 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:12.396052 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:12.400625 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:12.417987 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:12.420174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:12.421544 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:12.422960 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:12.423961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:12.424900 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:12.597179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:12.610104 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-267e0019-d652-40a2-a61b-b2407c6d484e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1319 microversion: 2.1 time: 0.334125 Oct 20 14:50:12.610893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 526/1032] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:12 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1319 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:12.633722 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:12.642876 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f7826c14-7bbd-47e3-95f9-80bf1a00aec3 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.265102 Oct 20 14:50:12.643453 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 507/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:12 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:13.634191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:13.635398 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:13.644126 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:13.644954 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:13.645634 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:13.647466 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:13.648193 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:13.648994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:13.666736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:13.668073 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:13.678879 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:13.679711 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:13.680420 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:13.682552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:13.683249 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:13.683885 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:13.887325 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:13.895354 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-7dcae214-e2b6-4c57-a7e3-2c857c41f1d8 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1319 microversion: 2.1 time: 0.265698 Oct 20 14:50:13.896685 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 527/1034] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:13 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:13.935121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:13.951194 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-369f6f8b-d5c4-48d3-89fd-1d7bbd9a4be7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.288163 Oct 20 14:50:13.952645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 508/1035] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:13 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:14.919580 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:14.920192 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:14.927074 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:14.928420 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:14.929152 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:14.930043 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:14.930684 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:14.931303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:14.981427 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:14.987785 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:14.995939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:14.997525 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:14.998222 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:14.999202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:14.999936 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:15.000636 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:15.060312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=2 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:15.092995 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell0:SELECT=6 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:15.135128 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:15.144758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6d22e96a-feee-4e71-90cc-83db4633a250 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1319 microversion: 2.1 time: 0.229461 Oct 20 14:50:15.145647 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 528/1036] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:14 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:15.203621 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:15.226517 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4865f7c7-4e33-4881-a86b-088d759e20c0 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.249055 Oct 20 14:50:15.227456 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 509/1037] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:14 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:16.173342 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:16.173863 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:16.181823 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:16.182303 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:16.182743 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:16.183446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:16.183905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:16.184334 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:16.251505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:16.252124 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:16.254447 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell0:SELECT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:16.260505 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:16.261010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:16.261454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:16.262161 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:16.262617 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:16.263195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:16.356878 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:16.364753 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-1942798a-dcda-4dd0-97fa-c8f8f2d29fd2 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1319 microversion: 2.1 time: 0.195298 Oct 20 14:50:16.365294 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 529/1038] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:16 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1319 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:16.418206 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:16.426087 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-d2e9e7a7-8d55-4afb-9138-9bafaaa1ac4e tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.178786 Oct 20 14:50:16.426594 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 510/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:16 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:16.740929 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-efa08b76-a0e7-40be-b5ac-4547ca28cbf0 req-e33995aa-7aff-4125-8cbe-f65ab0f2b62e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ec81db-0fa4-4b40-87a9-c4b86ed64dfa", "name": "network-vif-plugged", "status": "completed", "tag": "5b20a1ef-f714-4bf8-87d3-8b2cd39905eb"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:16.751051 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-efa08b76-a0e7-40be-b5ac-4547ca28cbf0 req-e33995aa-7aff-4125-8cbe-f65ab0f2b62e service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:16.751539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-efa08b76-a0e7-40be-b5ac-4547ca28cbf0 req-e33995aa-7aff-4125-8cbe-f65ab0f2b62e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:16.751970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-efa08b76-a0e7-40be-b5ac-4547ca28cbf0 req-e33995aa-7aff-4125-8cbe-f65ab0f2b62e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:16.763548 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-efa08b76-a0e7-40be-b5ac-4547ca28cbf0 req-e33995aa-7aff-4125-8cbe-f65ab0f2b62e service nova] Creating event network-vif-plugged:5b20a1ef-f714-4bf8-87d3-8b2cd39905eb for instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa on hv-cinder-77923 Oct 20 14:50:16.768475 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-efa08b76-a0e7-40be-b5ac-4547ca28cbf0 req-e33995aa-7aff-4125-8cbe-f65ab0f2b62e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031341 Oct 20 14:50:16.769064 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 530/1040] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:50:17.387627 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:17.388321 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:17.401847 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:17.402395 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:17.402961 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:17.403684 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:17.404115 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:17.405056 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:17.450573 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:17.451261 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:17.463882 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:17.464394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:17.464844 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:17.465672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:17.466122 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:17.466537 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:17.592557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:17.602577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-dc0da731-24f6-4b6b-a2a3-546d08b9c294 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1319 microversion: 2.1 time: 0.218920 Oct 20 14:50:17.603174 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 511/1041] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:17 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:17.647514 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:17.657170 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-2d44f3b9-3a03-4a5b-8e2f-0ea0453af509 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.210750 Oct 20 14:50:17.657830 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 531/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:17 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:18.627072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:18.627724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:18.634823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:18.635309 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:18.635763 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:18.636478 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:18.636933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:18.637357 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:18.682516 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:18.683132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:18.689828 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:18.690322 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:18.690758 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:18.691449 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:18.691908 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:18.692333 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:18.831682 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:18.840726 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f4519933-4552-4c9f-bfe9-55870e3d4c3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1509 microversion: 2.1 time: 0.217453 Oct 20 14:50:18.841813 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 512/1043] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:18 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1509 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:18.867317 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:18.869581 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "34be47dd-616c-4381-bbdd-e2e4ac93f361", "device": "/dev/sdb"}} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:18.872459 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:18.876075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8b6be01a-c2e0-43b4-b0c8-1ac4210b7e22 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.198533 Oct 20 14:50:18.878751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:18.879102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:18.879595 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:18.880372 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:18.880928 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:18.881781 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:18.888783 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 532/1044] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:18 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:19.131690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-f92d2afb-d9d7-4d32-b707-cdeb9c104f03 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "POST /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270323 Oct 20 14:50:19.132202 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 513/1045] 10.222.0.13 () {60 vars in 1323 bytes} [Thu Oct 20 14:50:18 2022] POST /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa/os-volume_attachments => generated 194 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:50:19.900941 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:19.901551 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:19.908314 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:19.908899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:19.909336 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:19.910118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:19.910657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:19.911050 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:20.056211 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:20.064113 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-555d8f9d-3250-4c65-9c3d-6f40d9d56bcf tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.168226 Oct 20 14:50:20.064728 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 533/1046] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:19 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:21.090485 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:21.091287 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:21.097497 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:21.097978 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:21.098405 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:21.099088 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:21.099745 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:21.100263 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:21.232586 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:21.236081 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:21.240974 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-394e7a2e-071a-43a0-b5ba-c8db7ff851b2 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.155830 Oct 20 14:50:21.241531 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 514/1047] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:21 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:22.264380 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:22.264999 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:22.271324 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:22.271809 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:22.272235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:22.272941 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:22.273387 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:22.273802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:22.404031 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:22.407620 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:22.412818 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f9ae6865-1118-4164-b501-8450ef5c17fe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1508 microversion: 2.1 time: 0.152264 Oct 20 14:50:22.413389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 534/1048] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:22 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:22.436058 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:22.436690 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:22.445142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:22.445627 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:22.446066 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:22.446757 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:22.447220 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:22.447642 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:22.490436 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=125810) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 20 14:50:22.558884 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-20320521-8076-48f3-823f-be8381f0847a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "POST /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c/action" status: 202 len: 0 microversion: 2.1 time: 0.126574 Oct 20 14:50:22.559414 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 515/1049] 10.222.0.13 () {60 vars in 1278 bytes} [Thu Oct 20 14:50:22 2022] POST /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c/action => generated 0 bytes in 128 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:50:22.567970 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:22.568670 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:22.575880 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:22.576407 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:22.576817 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:22.577512 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:22.577962 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:22.578381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:22.713727 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:22.722459 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a635580c-ceec-4a9a-b16a-8ea175048afa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1516 microversion: 2.1 time: 0.158891 Oct 20 14:50:22.723028 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 535/1050] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:22 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1516 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:23.747991 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:23.748649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:23.756552 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:23.757125 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:23.757783 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:23.758694 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:23.759259 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:23.759823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:23.889915 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:23.898209 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-4ff1e253-554c-4468-967f-4586ccf49b5f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1518 microversion: 2.1 time: 0.154725 Oct 20 14:50:23.898770 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 516/1051] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:23 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1518 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:24.724790 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-02a6dc5e-99fc-4620-b671-31b03f871f93 req-376dda0b-9355-40ab-a9de-64f978a9795e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "name": "network-vif-unplugged", "status": "completed", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:24.735027 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-02a6dc5e-99fc-4620-b671-31b03f871f93 req-376dda0b-9355-40ab-a9de-64f978a9795e service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:24.735508 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-02a6dc5e-99fc-4620-b671-31b03f871f93 req-376dda0b-9355-40ab-a9de-64f978a9795e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:24.735959 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-02a6dc5e-99fc-4620-b671-31b03f871f93 req-376dda0b-9355-40ab-a9de-64f978a9795e service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:24.748039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.compute.server_external_events [req-02a6dc5e-99fc-4620-b671-31b03f871f93 req-376dda0b-9355-40ab-a9de-64f978a9795e service nova] Unable to find a host for instance a4919bb2-0fa7-455d-bb9e-55db2807713c. Dropping event network-vif-unplugged {{(pid=125811) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 20 14:50:24.748973 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-02a6dc5e-99fc-4620-b671-31b03f871f93 req-376dda0b-9355-40ab-a9de-64f978a9795e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.028125 Oct 20 14:50:24.749595 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 536/1052] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 20 14:50:24.922523 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:24.923134 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:24.930609 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:24.931092 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:24.931526 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:24.932295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:24.932764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:24.933183 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:25.072667 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:25.080369 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-5650f055-ec14-4b54-8a2e-97d401362e6a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1518 microversion: 2.1 time: 0.161849 Oct 20 14:50:25.080925 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 517/1053] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:24 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:26.103978 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:26.104540 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:26.111048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:26.111523 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:26.111953 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:26.112672 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:26.113119 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:26.113534 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:26.243133 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:26.251254 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-63b902b8-facb-47dd-a29f-33b025dc9bbe tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.152097 Oct 20 14:50:26.251846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 537/1054] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:26 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:27.274905 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:27.275511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:27.281971 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:27.282448 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:27.282878 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:27.283561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:27.284006 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:27.284462 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:27.417462 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:27.425091 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6ce677c1-058c-44b1-8957-d994d431535a tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.154641 Oct 20 14:50:27.425656 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 518/1055] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:27 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:28.448889 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:28.449507 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:28.455938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:28.456455 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:28.456895 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:28.457588 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:28.458045 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:28.458476 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:28.589639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:28.597444 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-15540f5e-6016-40bc-9795-1e0f3aa55a92 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.152382 Oct 20 14:50:28.598020 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 538/1056] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:28 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:29.622142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:29.622751 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:29.628969 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:29.629442 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:29.629868 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:29.631111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:29.631577 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:29.631976 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:29.765826 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:29.773952 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-ca716ee6-4655-42ce-bbdd-490ea9182d61 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.156294 Oct 20 14:50:29.774520 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 519/1057] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:29 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:30.797591 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:30.798198 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:30.804848 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:30.805319 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:30.805748 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:30.806427 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:30.806870 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:30.807285 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:30.936652 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:30.945073 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8730085e-a599-418c-bc3d-0eba9166b60b tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.151382 Oct 20 14:50:30.945638 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 539/1058] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:30 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:31.969211 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:31.969832 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:31.977008 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:31.977483 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:31.977910 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:31.978598 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:31.979047 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:31.979468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:32.109292 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:32.117553 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-27cdf057-bc29-47c8-b6a2-415b0fdd30c7 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.152197 Oct 20 14:50:32.118121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 520/1059] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:31 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:33.141005 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:33.141643 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:33.148070 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:33.148587 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:33.149017 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:33.149691 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:33.150133 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:33.150544 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:33.285266 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:33.294389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-c900b7fb-56c5-4b64-bb16-0f6e30cf0889 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.156427 Oct 20 14:50:33.294389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 540/1060] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:33 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:34.317324 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:34.318711 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:34.320992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:34.326195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:34.326673 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:34.327188 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:34.328104 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:34.328651 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:34.329072 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:34.459571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:34.467207 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-7a3899d1-684a-4a17-843f-24cefd8215f5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.153865 Oct 20 14:50:34.467775 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 521/1061] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:34 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:35.490304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:35.490845 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:35.493091 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:35.498397 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:35.498931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:35.499361 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:35.500045 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:35.500555 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:35.500974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:35.636705 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:35.644662 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-61dbfd39-60b8-4618-8bff-5226350ba253 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.158615 Oct 20 14:50:35.645256 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 541/1062] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:35 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:36.668529 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:36.669144 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:36.675539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:36.676022 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:36.676494 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:36.677177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:36.678561 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:36.678992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:36.808317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:36.816156 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-13872870-7e4e-4805-af5e-116db786b1cd tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.151529 Oct 20 14:50:36.816764 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 522/1063] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:36 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:37.442487 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:37.444454 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:37.449438 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:37.449916 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:37.450373 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:37.451062 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:37.451509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:37.451927 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:37.531299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lazy-loading 'services' on Instance uuid 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:50:37.603569 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a8f43f62-64d2-44e3-a085-f4a5767a8d3e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "DELETE /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa/os-volume_attachments/34be47dd-616c-4381-bbdd-e2e4ac93f361" status: 202 len: 0 microversion: 2.1 time: 0.164807 Oct 20 14:50:37.604191 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 542/1064] 10.222.0.13 () {58 vars in 1416 bytes} [Thu Oct 20 14:50:37 2022] DELETE /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa/os-volume_attachments/34be47dd-616c-4381-bbdd-e2e4ac93f361 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:50:37.839892 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:37.840537 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:37.846939 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:37.847412 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:37.847840 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:37.848557 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:37.849014 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:37.849634 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:37.981443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:37.989074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-fcd6369f-d55f-497c-bb00-959694bba084 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.153007 Oct 20 14:50:37.989649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 523/1065] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:37 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:38.729321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:38.729899 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:38.736034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:38.736577 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:38.737006 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:38.737688 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:38.738132 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:38.738552 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:38.765044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:50:38.844875 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-a8c2dc8c-7292-4fde-884a-ddf8abecb850 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "DELETE /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 204 len: 0 microversion: 2.1 time: 0.120183 Oct 20 14:50:38.845796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 543/1066] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:50:38 2022] DELETE /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:50:38.855042 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:38.855763 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:38.862160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:38.862645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:38.863129 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:38.864010 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:38.864488 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:38.865901 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:38.997164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:39.004972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-bcc797f8-f66d-4460-ae82-8189c9a70d6e tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1515 microversion: 2.1 time: 0.153866 Oct 20 14:50:39.006140 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 524/1067] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:38 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:39.013232 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:39.014020 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:39.019980 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:39.020596 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:39.021112 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:39.022046 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:39.022572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:39.023071 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:39.155058 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:39.162815 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-0fe79830-48cf-4961-a72e-e2a1f6d81312 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.153814 Oct 20 14:50:39.163446 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 544/1068] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:39 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:40.029799 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:40.030467 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:40.037539 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:40.038021 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:40.038455 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:40.039148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:40.039600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:40.040033 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:40.172815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:40.181159 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b2b07890-18f9-453c-9293-e0aae5d2db10 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1515 microversion: 2.1 time: 0.155234 Oct 20 14:50:40.181719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 525/1069] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:40 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:40.186514 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:40.187165 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:40.193659 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:40.194137 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:40.194574 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:40.195291 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:40.195746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:40.196183 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:40.325965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:40.335321 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9292d289-8e63-47cf-bd9b-27b3db3a79fa tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.153142 Oct 20 14:50:40.335905 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 545/1070] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:40 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:50:40.788425 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-b2b4efc6-4b45-4d4a-b63a-07b01dc285df req-c701debf-5d23-44a3-9d1b-13f7d4942dd6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "name": "network-vif-plugged", "status": "completed", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:40.802386 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b2b4efc6-4b45-4d4a-b63a-07b01dc285df req-c701debf-5d23-44a3-9d1b-13f7d4942dd6 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:40.803283 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b2b4efc6-4b45-4d4a-b63a-07b01dc285df req-c701debf-5d23-44a3-9d1b-13f7d4942dd6 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:40.803904 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-b2b4efc6-4b45-4d4a-b63a-07b01dc285df req-c701debf-5d23-44a3-9d1b-13f7d4942dd6 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:40.817784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-b2b4efc6-4b45-4d4a-b63a-07b01dc285df req-c701debf-5d23-44a3-9d1b-13f7d4942dd6 service nova] Creating event network-vif-plugged:0526eee3-ed29-410b-be9e-e1916564638c for instance a4919bb2-0fa7-455d-bb9e-55db2807713c on hv-cinder-77923 Oct 20 14:50:40.825396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-b2b4efc6-4b45-4d4a-b63a-07b01dc285df req-c701debf-5d23-44a3-9d1b-13f7d4942dd6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041288 Oct 20 14:50:40.826371 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 526/1071] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:50:40.912681 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-d1004141-fa8b-4860-8656-ccf9f3e1a537 req-2b3ea725-b6d2-413d-a57b-97bca3e2a281 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "18ec81db-0fa4-4b40-87a9-c4b86ed64dfa", "name": "network-vif-deleted", "tag": "5b20a1ef-f714-4bf8-87d3-8b2cd39905eb"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:40.921859 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d1004141-fa8b-4860-8656-ccf9f3e1a537 req-2b3ea725-b6d2-413d-a57b-97bca3e2a281 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:40.922345 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d1004141-fa8b-4860-8656-ccf9f3e1a537 req-2b3ea725-b6d2-413d-a57b-97bca3e2a281 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:40.922771 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-d1004141-fa8b-4860-8656-ccf9f3e1a537 req-2b3ea725-b6d2-413d-a57b-97bca3e2a281 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:40.936902 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-d1004141-fa8b-4860-8656-ccf9f3e1a537 req-2b3ea725-b6d2-413d-a57b-97bca3e2a281 service nova] Creating event network-vif-deleted:5b20a1ef-f714-4bf8-87d3-8b2cd39905eb for instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa on hv-cinder-77923 Oct 20 14:50:40.942231 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-d1004141-fa8b-4860-8656-ccf9f3e1a537 req-2b3ea725-b6d2-413d-a57b-97bca3e2a281 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033349 Oct 20 14:50:40.942825 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 546/1072] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:50:41.205645 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:41.206351 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:41.212609 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:41.213099 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:41.213536 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:41.214241 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:41.214698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:41.215126 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:41.246139 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:41.246617 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:41.247055 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:41.247504 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.objects.instance [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lazy-loading 'fault' on Instance uuid 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa {{(pid=125810) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:50:41.288540 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36a281f7f9c8435c8ad65ae4b0bf141a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34676c921ba04710b14cfa94eab069d3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:41.296163 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7b69eae-043f-4931-8f75-423ef68f191f tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 200 len: 1309 microversion: 2.1 time: 0.095376 Oct 20 14:50:41.296771 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 527/1073] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:41 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:41.363692 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:41.366028 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:41.372186 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:41.372605 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:41.373034 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:41.373755 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:41.374207 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:41.374621 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:41.506255 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:41.514240 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-f65f2cc3-f8e9-4d84-8465-005f90ae5945 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1574 microversion: 2.1 time: 0.157906 Oct 20 14:50:41.514801 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 547/1074] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:41 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:42.320036 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:42.320706 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] [instance: 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:42.327063 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:42.327543 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:42.327972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:42.328685 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:42.329148 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:42.329551 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:42.342914 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] HTTP exception thrown: Instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa could not be found. Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Request method failure captured: Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa HTTP/1.1 Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV_LetO6c1r7iCjvOIz4tkFBFYSykUiZRCd8Iuz4CLP07V2GQYYptqWN7D9z1vF2A5tT5OcJ0l3_FX6JR8u720lCps_-3Mxbh0f4EKmjpwZ4gUiXFV-zl4Zbx2maMRbvJoO1U3IfG1hL4CDV2X9JiNmBgiB503faFvCn2Ba1R4mHfOM Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 34676c921ba04710b14cfa94eab069d3 Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1279269068 Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:50:42.345568 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_34676c921ba04710b14cfa94eab069d3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/34676c921ba04710b14cfa94eab069d3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34676c921ba04710b14cfa94eab069d3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/34676c921ba04710b14cfa94eab069d3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-VolumesSnapshotTestJSON-1279269068 Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 34676c921ba04710b14cfa94eab069d3 Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1279269068 Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-VolumesSnapshotTestJSON-1279269068-project Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: 36a281f7f9c8435c8ad65ae4b0bf141a Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-VolumesSnapshotTestJSON-1279269068-project Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa could not be found. Oct 20 14:50:42.347360 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '18ec81db-0fa4-4b40-87a9-c4b86ed64dfa'} Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa could not be found. Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:50:42.348362 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa could not be found. Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa could not be found. Oct 20 14:50:42.350528 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:42.351784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] Returning 404 to user: Instance 18ec81db-0fa4-4b40-87a9-c4b86ed64dfa could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:50:42.351784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a16fcf99-ae69-4a78-8868-8abce55b2e25 tempest-VolumesSnapshotTestJSON-1279269068 tempest-VolumesSnapshotTestJSON-1279269068-project] 10.222.0.13 "GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa" status: 404 len: 111 microversion: 2.1 time: 0.030947 Oct 20 14:50:42.351784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 528/1075] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:42 2022] GET /compute/v2.1/servers/18ec81db-0fa4-4b40-87a9-c4b86ed64dfa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:50:42.538300 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:42.538983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:42.549408 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:42.549925 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:42.550365 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:42.551063 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:42.551695 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:42.552477 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:42.714479 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:42.722306 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-306b2136-ed92-4303-aca3-533bda4c35d8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1561 microversion: 2.1 time: 0.188835 Oct 20 14:50:42.722861 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 548/1076] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:42 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1561 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:49.903157 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:49.903686 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:49.905956 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-27b40e19-2dfd-4dcc-8585-26b1fbbb0dee req-ad7db73b-d8c4-4251-8142-b37ce21bdb4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1625a58-d299-446e-81a2-4a623396811e", "tag": "f7f2b887-f376-4acb-bc3d-f1adb4222e6f"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:49.910332 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:49.910820 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:49.911247 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:49.912040 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:49.912842 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:49.913271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:49.916282 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-27b40e19-2dfd-4dcc-8585-26b1fbbb0dee req-ad7db73b-d8c4-4251-8142-b37ce21bdb4d service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:49.916893 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-27b40e19-2dfd-4dcc-8585-26b1fbbb0dee req-ad7db73b-d8c4-4251-8142-b37ce21bdb4d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:49.917332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-27b40e19-2dfd-4dcc-8585-26b1fbbb0dee req-ad7db73b-d8c4-4251-8142-b37ce21bdb4d service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:49.928639 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-27b40e19-2dfd-4dcc-8585-26b1fbbb0dee req-ad7db73b-d8c4-4251-8142-b37ce21bdb4d service nova] Creating event network-changed:f7f2b887-f376-4acb-bc3d-f1adb4222e6f for instance e1625a58-d299-446e-81a2-4a623396811e on hv-cinder-77923 Oct 20 14:50:49.934166 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-27b40e19-2dfd-4dcc-8585-26b1fbbb0dee req-ad7db73b-d8c4-4251-8142-b37ce21bdb4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032035 Oct 20 14:50:49.935085 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 549/1077] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:50:49.939988 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:50:49.994760 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:50.027554 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-e7f27099-d8cd-4413-b432-aedd429b0419 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "DELETE /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 204 len: 0 microversion: 2.1 time: 0.127841 Oct 20 14:50:50.036469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 529/1078] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:50:49 2022] DELETE /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:50:50.038389 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:50.039117 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:50.045453 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:50.045946 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:50.046381 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:50.047080 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:50.047532 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:50.047953 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:50.242136 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:50.249983 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fefbb026-ea21-4a6f-881e-7199a4fecee9 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1574 microversion: 2.1 time: 0.217234 Oct 20 14:50:50.250546 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 550/1079] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:50 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1574 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:51.274173 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:51.275513 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:51.282704 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:51.283396 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:51.283838 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:51.284587 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:51.285047 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:51.285473 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:51.466267 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:51.474034 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6d4bfb65-084c-43f3-a43d-3b3e698f8d48 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1574 microversion: 2.1 time: 0.204631 Oct 20 14:50:51.474724 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 530/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:51 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1574 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:52.036609 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-0c0dcacf-32a3-4f19-a947-418a12ff8374 req-31ba516c-db14-4ba5-a7bd-0dfd5404dbf6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1625a58-d299-446e-81a2-4a623396811e", "name": "network-vif-deleted", "tag": "f7f2b887-f376-4acb-bc3d-f1adb4222e6f"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:50:52.048409 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-0c0dcacf-32a3-4f19-a947-418a12ff8374 req-31ba516c-db14-4ba5-a7bd-0dfd5404dbf6 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:52.048900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-0c0dcacf-32a3-4f19-a947-418a12ff8374 req-31ba516c-db14-4ba5-a7bd-0dfd5404dbf6 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:52.049332 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-0c0dcacf-32a3-4f19-a947-418a12ff8374 req-31ba516c-db14-4ba5-a7bd-0dfd5404dbf6 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:52.054901 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:50:52.065000 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-0c0dcacf-32a3-4f19-a947-418a12ff8374 req-31ba516c-db14-4ba5-a7bd-0dfd5404dbf6 service nova] Creating event network-vif-deleted:f7f2b887-f376-4acb-bc3d-f1adb4222e6f for instance e1625a58-d299-446e-81a2-4a623396811e on hv-cinder-77923 Oct 20 14:50:52.071581 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-0c0dcacf-32a3-4f19-a947-418a12ff8374 req-31ba516c-db14-4ba5-a7bd-0dfd5404dbf6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038786 Oct 20 14:50:52.072167 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 551/1081] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:50:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:50:52.498925 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:52.499535 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:52.506513 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:52.506995 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:52.507424 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:52.508111 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:52.508602 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:52.509027 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:52.569468 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:52.577094 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-08bc24d2-600f-48f1-85d5-f39c857ee7be tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1226 microversion: 2.1 time: 0.082077 Oct 20 14:50:52.577659 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 531/1082] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:52 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1226 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:53.601235 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:53.601931 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:53.609179 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:53.609666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:53.610100 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:53.610798 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:53.611253 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:53.611671 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:53.676955 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:53.685898 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-6292fd94-3e76-4bd0-81ab-667f4a4462e8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1226 microversion: 2.1 time: 0.089956 Oct 20 14:50:53.686465 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 552/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:53 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1226 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:54.708778 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:54.709392 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:54.716219 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:54.716736 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:54.717171 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:54.717860 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:54.718321 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:54.718744 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:54.782415 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:54.790546 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-8aee149e-8d60-458d-b00e-2e87b7392fbc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1226 microversion: 2.1 time: 0.085712 Oct 20 14:50:54.791102 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 532/1084] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:54 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1226 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:55.813075 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:55.813698 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:55.820204 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:55.820740 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:55.821180 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:55.821890 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:55.822343 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:55.822767 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:55.857575 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:55.857984 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:55.858576 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:55.858864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.objects.instance [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lazy-loading 'fault' on Instance uuid e1625a58-d299-446e-81a2-4a623396811e {{(pid=125811) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 20 14:50:55.901145 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:50:55.909145 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-8e568db5-e1a4-4034-b898-9a6209661c35 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 200 len: 1231 microversion: 2.1 time: 0.099898 Oct 20 14:50:55.909733 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 553/1085] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:55 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 1231 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:50:56.933466 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:50:56.934030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: e1625a58-d299-446e-81a2-4a623396811e] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:50:56.940588 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:56.941070 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:56.941503 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:56.942195 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:50:56.942725 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:50:56.943151 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:50:56.957856 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] HTTP exception thrown: Instance e1625a58-d299-446e-81a2-4a623396811e could not be found. Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Request method failure captured: Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e HTTP/1.1 Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV5NO4FiehDVR025vDvFrQ37MIgZvJUKolQ2_09_kM7uzeb9ff6iSDMbTwqA3twz9LNVFERar8cb9FSWhQuYLImzoEDB6GfC8xVt-xpzU-az0WK1QPsaioNVcd2DnABJFwB8SftMgfEHSn3GFngGmionfIizuooGnZbbKamFLN8wZ3w Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:50:56.959545 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestVolumeBootPattern-563455495 Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: ac5921418d40446c80892b04a3eee12d Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance e1625a58-d299-446e-81a2-4a623396811e could not be found. Oct 20 14:50:56.961295 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'e1625a58-d299-446e-81a2-4a623396811e'} Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1625a58-d299-446e-81a2-4a623396811e could not be found. Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:50:56.962233 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1625a58-d299-446e-81a2-4a623396811e could not be found. Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1625a58-d299-446e-81a2-4a623396811e could not be found. Oct 20 14:50:56.963787 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:50:56.965187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Returning 404 to user: Instance e1625a58-d299-446e-81a2-4a623396811e could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:50:56.965187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-82dd5f19-ee3f-4fef-87c8-022b52f8b890 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e" status: 404 len: 111 microversion: 2.1 time: 0.033179 Oct 20 14:50:56.965187 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 533/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:50:56 2022] GET /compute/v2.1/servers/e1625a58-d299-446e-81a2-4a623396811e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:51:00.026957 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:00.027724 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:00.035492 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:00.036044 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:00.036618 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:00.037637 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:00.038367 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:00.038857 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:00.042761 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-bb8b6f97-fab4-4ae4-9490-12f249c81c2e req-4f89b55d-1b1f-4589-8e70-da2fea08d1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4bb0e5a-9c37-4177-858e-0f860a370f76", "tag": "ad316f32-43bd-4ee5-87a3-588ca6ffab22"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:51:00.053778 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-bb8b6f97-fab4-4ae4-9490-12f249c81c2e req-4f89b55d-1b1f-4589-8e70-da2fea08d1f1 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:00.054260 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-bb8b6f97-fab4-4ae4-9490-12f249c81c2e req-4f89b55d-1b1f-4589-8e70-da2fea08d1f1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:00.054949 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-bb8b6f97-fab4-4ae4-9490-12f249c81c2e req-4f89b55d-1b1f-4589-8e70-da2fea08d1f1 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:00.066762 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-bb8b6f97-fab4-4ae4-9490-12f249c81c2e req-4f89b55d-1b1f-4589-8e70-da2fea08d1f1 service nova] Creating event network-changed:ad316f32-43bd-4ee5-87a3-588ca6ffab22 for instance a4bb0e5a-9c37-4177-858e-0f860a370f76 on hv-cinder-77923 Oct 20 14:51:00.066974 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Going to try to terminate instance {{(pid=125811) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:51:00.072469 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-bb8b6f97-fab4-4ae4-9490-12f249c81c2e req-4f89b55d-1b1f-4589-8e70-da2fea08d1f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038669 Oct 20 14:51:00.073074 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 534/1087] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:51:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:51:00.156665 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b6a79995-b928-4a37-9ee6-809435283833 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 204 len: 0 microversion: 2.1 time: 0.135472 Oct 20 14:51:00.157617 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 554/1088] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:51:00 2022] DELETE /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:51:00.168317 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:00.169248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:00.176680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:00.177261 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:00.177765 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:00.179177 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:00.179992 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:00.180600 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:00.326699 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:51:00.335823 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-b47111dd-c042-49d5-9f47-b549cefb7244 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1574 microversion: 2.1 time: 0.172289 Oct 20 14:51:00.336443 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 535/1089] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:00 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1574 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:51:01.359850 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:01.360590 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:01.368572 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:01.369144 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:01.369586 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:01.370290 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:01.370746 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:01.371174 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:01.505963 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:51:01.515568 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-3a362cd3-6c34-4756-9260-b30db5958c50 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1574 microversion: 2.1 time: 0.159772 Oct 20 14:51:01.516210 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 555/1090] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:01 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1574 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:51:02.329746 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-e2b59ce4-32a8-4018-8ea7-f98c7b80c61d req-6bfa5627-c54c-45d4-8476-53f5cfedbdce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4bb0e5a-9c37-4177-858e-0f860a370f76", "name": "network-vif-deleted", "tag": "ad316f32-43bd-4ee5-87a3-588ca6ffab22"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:51:02.340238 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e2b59ce4-32a8-4018-8ea7-f98c7b80c61d req-6bfa5627-c54c-45d4-8476-53f5cfedbdce service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:02.340766 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e2b59ce4-32a8-4018-8ea7-f98c7b80c61d req-6bfa5627-c54c-45d4-8476-53f5cfedbdce service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:02.341201 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-e2b59ce4-32a8-4018-8ea7-f98c7b80c61d req-6bfa5627-c54c-45d4-8476-53f5cfedbdce service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:02.354108 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-e2b59ce4-32a8-4018-8ea7-f98c7b80c61d req-6bfa5627-c54c-45d4-8476-53f5cfedbdce service nova] Creating event network-vif-deleted:ad316f32-43bd-4ee5-87a3-588ca6ffab22 for instance a4bb0e5a-9c37-4177-858e-0f860a370f76 on hv-cinder-77923 Oct 20 14:51:02.359205 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-e2b59ce4-32a8-4018-8ea7-f98c7b80c61d req-6bfa5627-c54c-45d4-8476-53f5cfedbdce service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033064 Oct 20 14:51:02.359864 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 536/1091] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:51:02.539489 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:02.540260 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:02.546744 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:02.547304 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:02.547775 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:02.548509 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:02.548971 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:02.549394 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:02.613846 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ac5921418d40446c80892b04a3eee12d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5614088125349f1975cc55b25dd9dbc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:51:02.623975 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-9d6487ec-c052-47b6-91b1-a43eb904c8a8 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 200 len: 1225 microversion: 2.1 time: 0.088709 Oct 20 14:51:02.624655 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 556/1092] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:02 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:51:03.649185 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:03.649885 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: a4bb0e5a-9c37-4177-858e-0f860a370f76] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:03.656248 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:03.656797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:03.657304 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:03.658198 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:03.658715 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:03.659224 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:03.674172 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] HTTP exception thrown: Instance a4bb0e5a-9c37-4177-858e-0f860a370f76 could not be found. Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Request method failure captured: Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 HTTP/1.1 Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV5NO4FiehDVR025vDvFrQ37MIgZvJUKolQ2_09_kM7uzeb9ff6iSDMbTwqA3twz9LNVFERar8cb9FSWhQuYLImzoEDB6GfC8xVt-xpzU-az0WK1QPsaioNVcd2DnABJFwB8SftMgfEHSn3GFngGmionfIizuooGnZbbKamFLN8wZ3w Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:51:03.676017 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: ac5921418d40446c80892b04a3eee12d Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance a4bb0e5a-9c37-4177-858e-0f860a370f76 could not be found. Oct 20 14:51:03.677854 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'a4bb0e5a-9c37-4177-858e-0f860a370f76'} Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4bb0e5a-9c37-4177-858e-0f860a370f76 could not be found. Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:51:03.679271 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4bb0e5a-9c37-4177-858e-0f860a370f76 could not be found. Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4bb0e5a-9c37-4177-858e-0f860a370f76 could not be found. Oct 20 14:51:03.680680 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:03.681894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Returning 404 to user: Instance a4bb0e5a-9c37-4177-858e-0f860a370f76 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:51:03.681894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-9de7334e-0710-4b5d-87cf-dcc04907c7cc tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76" status: 404 len: 111 microversion: 2.1 time: 0.034077 Oct 20 14:51:03.681894 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 537/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:03 2022] GET /compute/v2.1/servers/a4bb0e5a-9c37-4177-858e-0f860a370f76 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 14:51:04.114834 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:04.115363 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:04.123275 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:04.124130 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:04.124971 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:04.126281 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:04.127039 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:04.127701 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:04.141802 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.wsgi [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] HTTP exception thrown: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Request method failure captured: Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: request: DELETE /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 HTTP/1.1 Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept: application/json Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Accept-Encoding: identity Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Connection: close Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Length: 0 Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Content-Type: application/json Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Host: 10.222.0.13 Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: Openstack-System-Scope: None Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: User-Agent: python-urllib3/1.26.12 Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Auth-Token: gAAAAABjUV5NO4FiehDVR025vDvFrQ37MIgZvJUKolQ2_09_kM7uzeb9ff6iSDMbTwqA3twz9LNVFERar8cb9FSWhQuYLImzoEDB6GfC8xVt-xpzU-az0WK1QPsaioNVcd2DnABJFwB8SftMgfEHSn3GFngGmionfIizuooGnZbbKamFLN8wZ3w Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Id: None Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Domain-Name: None Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Identity-Status: Confirmed Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Is-Admin-Project: True Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Id: default Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Domain-Name: Default Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Project-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Role: reader,member Oct 20 14:51:04.143470 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Roles: reader,member Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-Tenant-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Id: default Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Domain-Name: Default Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Id: ac5921418d40446c80892b04a3eee12d Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: X-User-Name: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: method: > Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: exception: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.145178 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: action_args: {'id': '0b82f520-a300-4205-9ff6-f31ec81518e0'} Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:51:04.146009 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.147318 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.148635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Returning 404 to user: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. {{(pid=125811) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:51:04.148635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-b2eef6ac-358a-43fc-911a-edcd7109d85d tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "DELETE /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 404 len: 111 microversion: 2.1 time: 0.034024 Oct 20 14:51:04.148635 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 557/1094] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:51:04 2022] DELETE /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:51:04.153555 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:04.154164 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] [instance: 0b82f520-a300-4205-9ff6-f31ec81518e0] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:04.160178 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:04.160691 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:04.161121 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:04.161805 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:04.162250 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:04.162669 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:04.175972 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] HTTP exception thrown: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Request method failure captured: Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 HTTP/1.1 Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV5NO4FiehDVR025vDvFrQ37MIgZvJUKolQ2_09_kM7uzeb9ff6iSDMbTwqA3twz9LNVFERar8cb9FSWhQuYLImzoEDB6GfC8xVt-xpzU-az0WK1QPsaioNVcd2DnABJFwB8SftMgfEHSn3GFngGmionfIizuooGnZbbKamFLN8wZ3w Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:51:04.177511 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d5614088125349f1975cc55b25dd9dbc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: d5614088125349f1975cc55b25dd9dbc Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestVolumeBootPattern-563455495 Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: ac5921418d40446c80892b04a3eee12d Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestVolumeBootPattern-563455495-project Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.179739 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': '0b82f520-a300-4205-9ff6-f31ec81518e0'} Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:51:04.180698 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. Oct 20 14:51:04.182257 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:51:04.183677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Returning 404 to user: Instance 0b82f520-a300-4205-9ff6-f31ec81518e0 could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:51:04.183677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-a69474aa-62fb-49c3-a1e8-1c803504eff6 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0" status: 404 len: 111 microversion: 2.1 time: 0.029642 Oct 20 14:51:04.183677 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 538/1095] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:04 2022] GET /compute/v2.1/servers/0b82f520-a300-4205-9ff6-f31ec81518e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 20 14:51:05.471524 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-cf45e993-97f5-4703-ab02-362c6c147453 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] Calling method '.version_select at 0x7f6344df4790>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:05.494429 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-cf45e993-97f5-4703-ab02-362c6c147453 tempest-TestVolumeBootPattern-563455495 tempest-TestVolumeBootPattern-563455495-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1163109215" status: 202 len: 0 microversion: 2.1 time: 0.026785 Oct 20 14:51:05.495118 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 558/1096] 10.222.0.13 () {58 vars in 1263 bytes} [Thu Oct 20 14:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1163109215 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 20 14:51:58.439019 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:58.439564 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:58.439666 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:58.440546 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG dbcounter [-] [125811] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=125811) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:58.442571 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:58.443218 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG dbcounter [-] [125810] Writing DB stats nova_cell1:SELECT=34 {{(pid=125810) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 20 14:51:58.449043 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:58.449797 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:58.450495 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:58.452231 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:58.452968 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:58.453290 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:58.483980 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Going to try to terminate instance {{(pid=125810) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 20 14:51:58.572632 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-426717f0-f2eb-448d-ac13-346730eee7b8 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 204 len: 0 microversion: 2.1 time: 0.137952 Oct 20 14:51:58.577160 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 539/1097] 10.222.0.13 () {58 vars in 1239 bytes} [Thu Oct 20 14:51:58 2022] DELETE /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 20 14:51:58.584028 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:58.584970 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:58.589994 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [req-46e6dea8-ae50-40a3-978b-a6b31999b217 req-6869a418-39a7-4a4e-8a5c-b5ee64cc1666 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:51:58.591815 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:58.592316 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:58.592784 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:58.593560 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:58.594022 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:58.594454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:58.601312 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-46e6dea8-ae50-40a3-978b-a6b31999b217 req-6869a418-39a7-4a4e-8a5c-b5ee64cc1666 service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:58.601796 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-46e6dea8-ae50-40a3-978b-a6b31999b217 req-6869a418-39a7-4a4e-8a5c-b5ee64cc1666 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:58.602301 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [req-46e6dea8-ae50-40a3-978b-a6b31999b217 req-6869a418-39a7-4a4e-8a5c-b5ee64cc1666 service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:58.614938 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.compute.server_external_events [req-46e6dea8-ae50-40a3-978b-a6b31999b217 req-6869a418-39a7-4a4e-8a5c-b5ee64cc1666 service nova] Creating event network-changed:0526eee3-ed29-410b-be9e-e1916564638c for instance a4919bb2-0fa7-455d-bb9e-55db2807713c on hv-cinder-77923 Oct 20 14:51:58.620510 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [req-46e6dea8-ae50-40a3-978b-a6b31999b217 req-6869a418-39a7-4a4e-8a5c-b5ee64cc1666 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182808 Oct 20 14:51:58.621287 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 559/1098] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:51:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 20 14:51:58.747083 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.policy [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125810) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:51:58.755085 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-c08dc2c6-7c27-43c8-9936-dbc425733356 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.176574 Oct 20 14:51:58.755738 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 540/1099] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:58 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 20 14:51:59.778864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:51:59.779712 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:51:59.786068 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:59.786539 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:59.786965 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:59.787657 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:51:59.788102 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:51:59.788551 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:51:59.919421 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:51:59.927871 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-01844821-29e4-4687-ac69-a1c995c72081 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1567 microversion: 2.1 time: 0.153955 Oct 20 14:51:59.928462 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 560/1100] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:51:59 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:52:00.795666 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [req-06340cd1-2c84-448b-97dc-5a64e9d47abb req-973f3f4f-146a-40fb-8309-fa4c164d957b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a4919bb2-0fa7-455d-bb9e-55db2807713c", "name": "network-vif-deleted", "tag": "0526eee3-ed29-410b-be9e-e1916564638c"}]} {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 20 14:52:00.805030 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-06340cd1-2c84-448b-97dc-5a64e9d47abb req-973f3f4f-146a-40fb-8309-fa4c164d957b service nova] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:52:00.805514 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-06340cd1-2c84-448b-97dc-5a64e9d47abb req-973f3f4f-146a-40fb-8309-fa4c164d957b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:52:00.805947 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [req-06340cd1-2c84-448b-97dc-5a64e9d47abb req-973f3f4f-146a-40fb-8309-fa4c164d957b service nova] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:52:00.818649 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.compute.server_external_events [req-06340cd1-2c84-448b-97dc-5a64e9d47abb req-973f3f4f-146a-40fb-8309-fa4c164d957b service nova] Creating event network-vif-deleted:0526eee3-ed29-410b-be9e-e1916564638c for instance a4919bb2-0fa7-455d-bb9e-55db2807713c on hv-cinder-77923 Oct 20 14:52:00.823806 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [req-06340cd1-2c84-448b-97dc-5a64e9d47abb req-973f3f4f-146a-40fb-8309-fa4c164d957b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091398 Oct 20 14:52:00.824430 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 541/1101] 10.222.0.13 () {64 vars in 1317 bytes} [Thu Oct 20 14:52:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 20 14:52:00.952560 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:52:00.953900 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.compute.api [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125811) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:52:00.960358 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:52:00.960864 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:52:00.961299 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:52:00.961990 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:52:00.962442 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:52:00.962862 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG oslo_concurrency.lockutils [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125811) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:52:01.038280 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.policy [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd7383d936b3544ccb9093a3beeb5cbd3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '370ff2b623ce4dfc992a266bd41ee51e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=125811) authorize /opt/stack/nova/nova/policy.py:199}} Oct 20 14:52:01.046808 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-56624ff2-1e16-49de-8eb6-53befe3113d5 tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 200 len: 1218 microversion: 2.1 time: 0.098302 Oct 20 14:52:01.048038 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 561/1102] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:52:00 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 1218 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 20 14:52:02.072203 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '>' {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:52:02.072933 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.compute.api [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] [instance: a4919bb2-0fa7-455d-bb9e-55db2807713c] Fetching instance by UUID {{(pid=125810) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 20 14:52:02.079480 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:52:02.079956 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:52:02.080416 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:52:02.081142 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Acquiring lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 20 14:52:02.081597 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 20 14:52:02.082046 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG oslo_concurrency.lockutils [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Lock "ed54df7a-e597-4093-8f8e-592e2d1a176d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=125810) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 20 14:52:02.095719 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.wsgi [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] HTTP exception thrown: Instance a4919bb2-0fa7-455d-bb9e-55db2807713c could not be found. Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Request method failure captured: Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: request: GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c HTTP/1.1 Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept: application/json Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Accept-Encoding: identity Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Connection: close Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Length: 0 Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Content-Type: application/json Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Host: 10.222.0.13 Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: Openstack-System-Scope: None Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: User-Agent: python-urllib3/1.26.12 Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Auth-Token: gAAAAABjUV9Vp6L9rHlIq42kxIwSP9o14gY_DQolu5UfsKfAIt406Vb4CW4kBnrUdKb7_8I5gQOtQwi6KP7wReDAw75JE8f6OpySnL5oDavOCwRU4cEO8smwY4DDI1Wn0YcNe4uGZ3zcCihw4VoudikWT7BKq6DzXp-FJIRHvO3JCvgIW52Jo-U Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Id: None Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Domain-Name: None Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Identity-Status: Confirmed Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Is-Admin-Project: True Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Id: default Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Domain-Name: Default Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Id: 370ff2b623ce4dfc992a266bd41ee51e Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Project-Name: tempest-TestShelveInstance-897544466 Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Role: reader,member Oct 20 14:52:02.097454 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Roles: reader,member Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.13:8080", "publicURL": "http://10.222.0.13:8080/v1/AUTH_370ff2b623ce4dfc992a266bd41ee51e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/370ff2b623ce4dfc992a266bd41ee51e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/370ff2b623ce4dfc992a266bd41ee51e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/370ff2b623ce4dfc992a266bd41ee51e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}] Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant: tempest-TestShelveInstance-897544466 Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Id: 370ff2b623ce4dfc992a266bd41ee51e Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-Tenant-Name: tempest-TestShelveInstance-897544466 Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User: tempest-TestShelveInstance-897544466-project Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Id: default Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Domain-Name: Default Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Id: d7383d936b3544ccb9093a3beeb5cbd3 Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: X-User-Name: tempest-TestShelveInstance-897544466-project Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: method: > Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: exception: Instance a4919bb2-0fa7-455d-bb9e-55db2807713c could not be found. Oct 20 14:52:02.099573 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: action_args: {'id': 'a4919bb2-0fa7-455d-bb9e-55db2807713c'} Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: {{(pid=125810) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a4919bb2-0fa7-455d-bb9e-55db2807713c could not be found. Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 20 14:52:02.100670 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a4919bb2-0fa7-455d-bb9e-55db2807713c could not be found. Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a4919bb2-0fa7-455d-bb9e-55db2807713c could not be found. Oct 20 14:52:02.102378 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: ERROR nova.api.openstack.wsgi Oct 20 14:52:02.103922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: DEBUG nova.api.openstack.wsgi [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Returning 404 to user: Instance a4919bb2-0fa7-455d-bb9e-55db2807713c could not be found. {{(pid=125810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 20 14:52:02.103922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: INFO nova.api.openstack.requestlog [None req-6b699150-0fe5-45b0-81a3-bbae623c2a9c tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c" status: 404 len: 111 microversion: 2.1 time: 0.031632 Oct 20 14:52:02.103922 dv-cinder-779233-7-iscsi devstack@n-api.service[125810]: [pid: 125810|app: 0|req: 542/1103] 10.222.0.13 () {58 vars in 1236 bytes} [Thu Oct 20 14:52:02 2022] GET /compute/v2.1/servers/a4919bb2-0fa7-455d-bb9e-55db2807713c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 20 14:52:02.257048 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: DEBUG nova.api.openstack.wsgi [None req-fc022e4c-014e-46f1-b62b-f4da0133906f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] Calling method '.version_select at 0x7f6344e53160>' {{(pid=125811) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 20 14:52:02.278526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: INFO nova.api.openstack.requestlog [None req-fc022e4c-014e-46f1-b62b-f4da0133906f tempest-TestShelveInstance-897544466 tempest-TestShelveInstance-897544466-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-711448910" status: 202 len: 0 microversion: 2.1 time: 0.024499 Oct 20 14:52:02.278526 dv-cinder-779233-7-iscsi devstack@n-api.service[125811]: [pid: 125811|app: 0|req: 562/1104] 10.222.0.13 () {58 vars in 1251 bytes} [Thu Oct 20 14:52:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-711448910 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)